File: //usr/local/lib/python3.7/site-packages/pip/_vendor/requests/__pycache__/utils.cpython-37.pyc
B
L��g�� � @ s� d Z ddlZddlZddlZddlZddlZddlZddlZddlZddl Z ddl
Z
ddl Z ddl m
Z
ddlmZmZ ddlmZ ddlmZ ddlmZmZmZmZ dd lmZmZm Z m Z m Z m Z dd
lm Z! dd lm"Z"m#Z#m$Z$m%Z%m&Z&m'Z'm(Z( dd l)m*Z* dd
l+m,Z,m-Z-m.Z.m/Z/ ddl0m1Z1 dZ2e�3� Z4ddd�Z5d�6e�7dedd�d ��Z8ej9dk�rvdd� Z:dd � Z"d d � Z;d d � Z<dtd"d#�Z=d$d%� Z>d&d'� Z?ej@d(d)� �ZAd*d+� ZBd,d-� ZCd.d/� ZDd0d1� ZEdud2d3�ZFd4d5� ZGd6d7� ZHd8d9� ZId:d;� ZJd<d=� ZKd>d?� ZLd@dA� ZMdBdC� ZNeOdD�ZPdEdF� ZQdGdH� ZRdIdJ� ZSdKdL� ZTdMdN� ZUdOdP� ZVej@dQdR� �ZWdSdT� ZXdvdUdV�ZYdWdX� ZZdwdYdZ�Z[dxd\d]�Z\d^d_� Z]d`da� Z^db�_dc�Z`e`dd Zae`de Zbdfdg� Zcdhdi� Zddjdk� Zedldm� Zfdndo� Zgdpdq� Zhdrds� ZidS )yz�
requests.utils
~~~~~~~~~~~~~~
This module provides utility functions that are used within Requests
that are also useful for external consumption.
� N)� OrderedDict)� make_headers� parse_url� )�certs)� __version__)�_HEADER_VALIDATORS_BYTE�_HEADER_VALIDATORS_STR�HEADER_VALIDATORS�to_native_string)�Mapping�
basestring�bytes�
getproxies�getproxies_environment�
integer_types)�parse_http_list)� proxy_bypass�proxy_bypass_environment�quote�str�unquote�urlparse�
urlunparse)�cookiejar_from_dict)�FileModeWarning�
InvalidHeader�
InvalidURL�UnrewindableBodyError)�CaseInsensitiveDict)z.netrc�_netrc�P i� )�http�httpsz, z,\s*T)�accept_encodingzaccept-encoding�win32c C s� y dd l }W n tk
r dS X y6|�|jd�}t|�|d�d �}|�|d�d }W n ttfk
rp dS X |rz|s~dS |�d�}xX|D ]P}|dkr�d| kr�d S |� dd
�}|� d d �}|� d
d�}t
� || t
j �r�d S q�W dS )Nr Fz;Software\Microsoft\Windows\CurrentVersion\Internet SettingsZ ProxyEnableZ
ProxyOverride�;z<local>�.Tz\.�*z.*�?)
�winreg� ImportError�OpenKey�HKEY_CURRENT_USER�int� QueryValueEx�OSError�
ValueError�split�replace�re�match�I)�hostr* ZinternetSettingsZ proxyEnableZ
proxyOverride�test� r9 �>/tmp/pip-unpacked-wheel-hv55ucu3/pip/_vendor/requests/utils.py�proxy_bypass_registryL s2
r; c C s t � rt| �S t| �S dS )z�Return True, if the host should be bypassed.
Checks proxy settings gathered from the environment, if specified,
or the registry.
N)r r r; )r7 r9 r9 r: r p s r c C s t | d�r| �� } | S )z/Returns an internal sequence dictionary update.�items)�hasattrr< )�dr9 r9 r: �dict_to_sequence| s
r? c C s0 d }d}t | d�r t| �}nft | d�r.| j}nTt | d�r�y | �� }W n tjtfk
r^ Y n$X t�|�j}d| j kr�t
� dt � t | d��ry | �
� }W n tk
r� |d k r�|}Y nZX t | d��r|d k�ry&| �dd � | �
� }| �|p�d� W n tk
�r d}Y nX |d k�r"d}td|| �S )
Nr �__len__�len�fileno�ba% Requests has determined the content-length for this request using the binary size of the file: however, the file has been opened in text mode (i.e. without the 'b' flag in the mode). This may lead to an incorrect content-length. In Requests 3.0, support will be removed for files in text mode.�tell�seek� )r= rA rB �io�UnsupportedOperation�AttributeError�os�fstat�st_size�mode�warnings�warnr rD r0 rE �max)�o� total_length�current_positionrB r9 r9 r: � super_len� s@
rT Fc C s> t j�d�}|dk r |f}ndd� tD �}y�ddlm}m} d}xD|D ]<}yt j�|�}W n tk
rn dS X t j� |�rF|}P qFW |dkr�dS t
| �} d}
t | t �r�|
�
d�}
| j�|
�d } y6||��| �} | r�| d r�dnd }
| |
| d
fS W n" |tfk
�r |�r� Y nX W n ttfk
�r8 Y nX dS ) z;Returns the Requests tuple auth for a given url from netrc.ZNETRCNc s s | ]}d |� �V qdS )z~/Nr9 )�.0�fr9 r9 r: � <genexpr>� s z!get_netrc_auth.<locals>.<genexpr>r )�NetrcParseError�netrc� :�asciir rF )rJ �environ�get� NETRC_FILESrY rX �path�
expanduser�KeyError�existsr �
isinstancer �decode�netlocr2 �authenticatorsr0 r+ rI )�url� raise_errorsZ
netrc_fileZnetrc_locationsrX rY �
netrc_pathrV �loc�ri�splitstrr7 r �login_ir9 r9 r: �get_netrc_auth� s@
rn c C sB t | dd�}|r>t|t�r>|d dkr>|d dkr>tj�|�S dS )z0Tries to guess the filename of the given object.�nameNr �<����>)�getattrrc r
rJ r_ �basename)�objro r9 r9 r: �guess_filename s &rv c C s� t j�| �r| S t j�| �\}}x8|rXt j�|�sXt j�|�\}}|sHP d�||g�}q"W t�|�sh| S t�|�}||�� kr�| S t �
� }t j�||�d�d �}t j�|�s�t |��}|� |�
|�� W dQ R X |S )z�Replace nonexistent paths that look like they refer to a member of a zip
archive with the location of an extracted copy of the target, or else
just return the provided path unchanged.
�/rq N)rJ r_ rb r2 �join�zipfile�
is_zipfile�ZipFile�namelist�tempfile�
gettempdir� atomic_open�write�read)r_ �archive�member�prefix�zip_file�tmp�extracted_pathZ file_handlerr9 r9 r: �extract_zipped_paths s&
r� c c sl t jtj�| �d�\}}y.t�|d�� }|V W dQ R X t�|| � W n tk
rf t�|� � Y nX dS )z-Write a file to the disk in an atomic fashion)�dir�wbN) r} �mkstemprJ r_ �dirname�fdopenr3 �
BaseException�remove)�filenameZtmp_descriptorZtmp_nameZ tmp_handlerr9 r9 r: r , s
r c C s. | dkr dS t | ttttf�r&td��t| �S )a Take an object and test to see if it can be represented as a
dictionary. Unless it can not be represented as such, return an
OrderedDict, e.g.,
::
>>> from_key_val_list([('key', 'val')])
OrderedDict([('key', 'val')])
>>> from_key_val_list('string')
Traceback (most recent call last):
...
ValueError: cannot encode objects that are not 2-tuples
>>> from_key_val_list({'key': 'val'})
OrderedDict([('key', 'val')])
:rtype: OrderedDict
Nz+cannot encode objects that are not 2-tuples)rc r r �boolr. r1 r )�valuer9 r9 r: �from_key_val_list9 s
r� c C s@ | dkr dS t | ttttf�r&td��t | t�r8| �� } t| �S )a� Take an object and test to see if it can be represented as a
dictionary. If it can be, return a list of tuples, e.g.,
::
>>> to_key_val_list([('key', 'val')])
[('key', 'val')]
>>> to_key_val_list({'key': 'val'})
[('key', 'val')]
>>> to_key_val_list('string')
Traceback (most recent call last):
...
ValueError: cannot encode objects that are not 2-tuples
:rtype: list
Nz+cannot encode objects that are not 2-tuples) rc r r r� r. r1 r r< �list)r� r9 r9 r: �to_key_val_listT s
r� c C s\ g }xRt | �D ]F}|dd� |dd� kr6dkrJn nt|dd� �}|�|� qW |S )a Parse lists as described by RFC 2068 Section 2.
In particular, parse comma-separated lists where the elements of
the list may include quoted-strings. A quoted-string could
contain a comma. A non-quoted string could have quotes in the
middle. Quotes are removed automatically after parsing.
It basically works like :func:`parse_set_header` just that items
may appear multiple times and case sensitivity is preserved.
The return value is a standard :class:`list`:
>>> parse_list_header('token, "quoted value"')
['token', 'quoted value']
To create a header from the :class:`list` again, use the
:func:`dump_header` function.
:param value: a string with a list header.
:return: :class:`list`
:rtype: list
Nr rq �")�_parse_list_header�unquote_header_value�append)r� �result�itemr9 r9 r: �parse_list_headerr s (r� c C s| i }xrt | �D ]f}d|kr$d||< q|�dd�\}} | dd� | dd� krXdkrln nt| dd� �} | ||< qW |S )a^ Parse lists of key, value pairs as described by RFC 2068 Section 2 and
convert them into a python dict:
>>> d = parse_dict_header('foo="is a fish", bar="as well"')
>>> type(d) is dict
True
>>> sorted(d.items())
[('bar', 'as well'), ('foo', 'is a fish')]
If there is no value for a key it will be `None`:
>>> parse_dict_header('key_without_value')
{'key_without_value': None}
To create a header from the :class:`dict` again, use the
:func:`dump_header` function.
:param value: a string with a dict header.
:return: :class:`dict`
:rtype: dict
�=Nr rq r� )r� r2 r� )r� r� r� ro r9 r9 r: �parse_dict_header� s ( r� c C s\ | rX| d | d kr dkrXn n4| dd� } |rD| dd� dkrX| � dd�� d d�S | S )
z�Unquotes a header value. (Reversal of :func:`quote_header_value`).
This does not use the real unquoting but what browsers are actually
using for quoting.
:param value: the header value to unquote.
:rtype: str
r rq r� r NrF z\\�\z\")r3 )r� � is_filenamer9 r9 r: r� � s
$ r� c C s" i }x| D ]}|j ||j< q
W |S )z�Returns a key/value dictionary from a CookieJar.
:param cj: CookieJar object to extract cookies from.
:rtype: dict
)r� ro )�cj� cookie_dict�cookier9 r9 r: �dict_from_cookiejar� s
r� c C s
t || �S )z�Returns a CookieJar from a key/value dictionary.
:param cj: CookieJar to insert cookies into.
:param cookie_dict: Dict of key/values to insert into CookieJar.
:rtype: CookieJar
)r )r� r� r9 r9 r: �add_dict_to_cookiejar� s r� c C sT t �dt� tjdtjd�}tjdtjd�}t�d�}|�| �|�| � |�| � S )zlReturns encodings from given content string.
:param content: bytestring to extract encodings from.
z�In requests 3.0, get_encodings_from_content will be removed. For more information, please see the discussion on issue #2266. (This warning should only appear once.)z!<meta.*?charset=["\']*(.+?)["\'>])�flagsz+<meta.*?content=["\']*;?charset=(.+?)["\'>]z$^<\?xml.*?encoding=["\']*(.+?)["\'>])rN rO �DeprecationWarningr4 �compiler6 �findall)�content�
charset_re� pragma_re�xml_rer9 r9 r: �get_encodings_from_content� s
r� c
C s� | � d�}|d �� |dd� }}i }d}xh|D ]`}|�� }|r2|d }}|�d�} | dkr�|d| � �|�}|| d d� �|�}|||�� < q2W ||fS ) z�Returns content type and parameters from given header
:param header: string
:return: tuple containing content type and dictionary of
parameters
r& r r Nz"' Tr� rq )r2 �strip�find�lower)
�header�tokens� content_type�params� params_dict�items_to_strip�param�keyr� �index_of_equalsr9 r9 r: �_parse_content_type_header s
r� c C sP | � d�}|sdS t|�\}}d|kr4|d �d�S d|kr@dS d|krLdS dS ) z}Returns encodings from given HTTP Header Dict.
:param headers: dictionary to extract encoding from.
:rtype: str
z content-typeN�charsetz'"�textz
ISO-8859-1zapplication/jsonzutf-8)r] r� r� )�headersr� r� r9 r9 r: �get_encoding_from_headers s
r� c c sh |j dkr| E dH dS t�|j �dd�}x | D ]}|�|�}|r0|V q0W |jddd�}|rd|V dS )zStream decodes an iterator.Nr3 )�errors� T)�final)�encoding�codecs�getincrementaldecoderrd )�iterator�r�decoder�chunk�rvr9 r9 r: � stream_decode_response_unicode3 s
r� c c sL d}|dks|dkr t | �}x*|t | �k rF| ||| � V ||7 }q W dS )z Iterate over slices of a string.r N)rA )�string� slice_length�posr9 r9 r: � iter_slicesD s r� c C sv t �dt� g }t| j�}|rJy t| j|�S tk
rH |�|� Y nX yt| j|dd�S t k
rp | jS X dS )z�Returns the requested content back in unicode.
:param r: Response object to get unicode content from.
Tried:
1. charset from content-type
2. fall back and replace all unicode characters
:rtype: str
z�In requests 3.0, get_unicode_from_response will be removed. For more information, please see the discussion on issue #2266. (This warning should only appear once.)r3 )r� N)
rN rO r� r� r� r r� � UnicodeErrorr� � TypeError)r� �tried_encodingsr� r9 r9 r: �get_unicode_from_responseN s
r� zBABCDEFGHIJKLMNOPQRSTUVWXYZabcdefghijklmnopqrstuvwxyz0123456789-._~c C s� | � d�}x�tdt|��D ]�}|| dd� }t|�dkr�|�� r�ytt|d��}W n$ tk
rx td|� d���Y nX |tkr�||| dd� ||< q�d|| � �||< qd|| � �||< qW d � |�S )
z�Un-escape any percent-escape sequences in a URI that are unreserved
characters. This leaves all reserved, illegal and non-ASCII bytes encoded.
:rtype: str
�%r r rF � z"Invalid percent-escape sequence: '�'N� )
r2 �rangerA �isalnum�chrr. r1 r �UNRESERVED_SETrx )�uri�parts�i�h�cr9 r9 r: �unquote_unreserved{ s
r� c C s: d}d}yt t| �|d�S tk
r4 t | |d�S X dS )z�Re-quote the given URI.
This function passes the given URI through an unquote/quote cycle to
ensure that it is fully and consistently quoted.
:rtype: str
z!#$%&'()*+,/:;=?@[]~z!#$&'()*+,/:;=?@[]~)�safeN)r r� r )r� �safe_with_percent�safe_without_percentr9 r9 r: � requote_uri� s r� c C sl t �dt�| ��d }|�d�\}}t �dt�tt|����d }t �dt�|��d |@ }||@ ||@ kS )z�This function allows you to check if an IP belongs to a network subnet
Example: returns True if ip = 192.168.1.1 and net = 192.168.1.0/24
returns False if ip = 192.168.1.1 and net = 192.168.100.0/24
:rtype: bool
z=Lr rw )�struct�unpack�socket� inet_atonr2 �dotted_netmaskr. )�ip�net�ipaddr�netaddr�bits�netmask�networkr9 r9 r: �address_in_network� s
r� c C s& ddd| > d A }t �t�d|��S )z�Converts mask from /xx format to xxx.xxx.xxx.xxx
Example: if mask is 24 function returns 255.255.255.0
:rtype: str
l �� r � z>I)r� � inet_ntoar� �pack)�maskr� r9 r9 r: r� � s r� c C s( yt �| � W n tk
r" dS X dS )z
:rtype: bool
FT)r� r� r0 )� string_ipr9 r9 r: �is_ipv4_address� s
r� c C s� | � d�dkr~yt| �d�d �}W n tk
r8 dS X |dk sJ|dkrNdS yt�| �d�d � W q� tk
rz dS X ndS dS )zV
Very simple check of the cidr format in no_proxy variable.
:rtype: bool
rw r Fr� r T)�countr. r2 r1 r� r� r0 )�string_networkr� r9 r9 r: �
is_valid_cidr� s r� c c sT |dk }|r"t j�| �}|t j| < z
dV W d|rN|dkrDt j| = n
|t j| < X dS )z�Set the environment variable 'env_name' to 'value'
Save previous value, yield, and then restore the previous value stored in
the environment variable 'env_name'.
If 'value' is None, do nothingN)rJ r\ r] )�env_namer� �
value_changed� old_valuer9 r9 r: � set_environ� s
r� c
C s, dd� }|}|dkr |d�}t | �}|jdkr2dS |r�dd� |�dd ��d
�D �}t|j�r�xz|D ],}t|�r�t|j|�r�dS qb|j|krbdS qbW nD|j}|jr�|d |j� �7 }x&|D ] }|j�|�s�|�|�r�dS q�W t d|��6 yt
|j�}W n t t j
fk
�r d }Y nX W dQ R X |�r(dS d S )
zL
Returns whether we should bypass proxies or not.
:rtype: bool
c S s t j�| �pt j�| �� �S )N)rJ r\ r] �upper)r� r9 r9 r: � get_proxy s z(should_bypass_proxies.<locals>.get_proxyN�no_proxyTc s s | ]}|r|V qd S )Nr9 )rU r7 r9 r9 r: rW s z(should_bypass_proxies.<locals>.<genexpr>� r� �,�:F)r �hostnamer3 r2 r� r� r� �port�endswithr� r r� r� �gaierror) rg r r � no_proxy_arg�parsed�proxy_ip�host_with_portr7 �bypassr9 r9 r: �should_bypass_proxies� s<
r c C s t | |d�ri S t� S dS )zA
Return a dict of environment proxies.
:rtype: dict
)r N)r r )rg r r9 r9 r: �get_environ_proxies8 s r c C sv |pi }t | �}|jdkr.|�|j|�d��S |jd |j |jd|j dg}d}x |D ]}||krX|| }P qXW |S )z�Select a proxy for the url, if applicable.
:param url: The url being for the request
:param proxies: A dictionary of schemes or schemes and hosts to proxy URLs
N�allz://zall://)r r r] �scheme)rg �proxies�urlparts�
proxy_keys�proxy� proxy_keyr9 r9 r: � select_proxyD s
r c C st |dk r |ni }| j }t|�j}|�d�}|�� }|rpt||d�spt||d�}|�||�d��}|rp|�||� |S )a� This method takes proxy information from a request and configuration
input to resolve a mapping of target proxies. This will consider settings
such a NO_PROXY to strip proxy configurations.
:param request: Request or PreparedRequest
:param proxies: A dictionary of schemes or schemes and hosts to proxy URLs
:param trust_env: Boolean declaring whether to trust environment configs
:rtype: dict
Nr )r r )rg r r r] �copyr r �
setdefault) �requestr � trust_envrg r r � new_proxies�environ_proxiesr r9 r9 r: �resolve_proxies^ s
r �python-requestsc C s | � dt � �S )zO
Return a string representing the default user agent.
:rtype: str
rw )r )ro r9 r9 r: �default_user_agenty s r! c C s t t� tddd��S )z9
:rtype: requests.structures.CaseInsensitiveDict
z*/*z
keep-alive)z
User-AgentzAccept-Encoding�Accept�
Connection)r r! �DEFAULT_ACCEPT_ENCODINGr9 r9 r9 r: �default_headers� s
r% c
C s� g }d}| � |�} | s|S x�t�d| �D ]�}y|�dd�\}}W n tk
r^ |d }}Y nX d|� d�i}xP|�d�D ]B}y|�d�\}} W n tk
r� P Y nX | � |�||� |�< qzW |�|� q(W |S ) z�Return a list of parsed link headers proxies.
i.e. Link: <http:/.../front.jpeg>; rel=front; type="image/jpeg",<http://.../back.jpeg>; rel=back;type="image/jpeg"
:rtype: list
z '"z, *<r& r r� rg z<> '"r� )r� r4 r2 r1 r� ) r� �links�
replace_chars�valrg r� �linkr� r� r9 r9 r: �parse_header_links� s&
r* � r[ rF � c C s� | dd� }|t jt jfkr dS |dd� t jkr6dS |dd� t jt jfkrRdS |�t�}|dkrhd S |dkr�|ddd� tkr�d
S |d dd� tkr�d S |dkr�|dd� t kr�d
S |d d� t kr�dS dS )z
:rtype: str
N� zutf-32r, z utf-8-sigrF zutf-16r zutf-8z utf-16-ber z utf-16-lez utf-32-bez utf-32-le)
r� � BOM_UTF32_LE� BOM_UTF32_BE�BOM_UTF8� BOM_UTF16_LE� BOM_UTF16_BEr� �_null�_null2�_null3)�data�sample� nullcountr9 r9 r: �guess_json_utf� s*
r9 c C sl t | �}|\}}}}}}} |j}
|
s.||
}
}|r@d�||
g�}
|dkrL|}|dkrXd}t||
|d|| f�S )z�Given a URL that may or may not have a scheme, prepend the given scheme.
Does not replace a present scheme with the one provided as an argument.
:rtype: str
�@Nr� )r re rx r ) rg �
new_schemer r �authr7 r r_ �query�fragmentre r9 r9 r: �prepend_scheme_if_needed� s
r? c C sB t | �}yt|j�t|j�f}W n ttfk
r< d}Y nX |S )z{Given a url with authentication components, extract them into a tuple of
username,password.
:rtype: (str,str)
)r� r� )r r �username�passwordrI r� )rg r r< r9 r9 r: �get_auth_from_url� s
rB c C s$ | \}}t | |d� t | |d� dS )z�Verifies that header parts don't contain leading whitespace
reserved characters, or return characters.
:param header: tuple, in the format (name, value).
r r N)�_validate_header_part)r� ro r� r9 r9 r: �check_header_validity s rD c C sx t |t�rt| }n2t |t�r(t| }n td|�d| � dt|�� ���|�|�st|dkr\dnd}td|� d|����d S ) Nz
Header part (z) from z# must be of type str or bytes, not r ro r� zSInvalid leading whitespace, reserved character(s), or returncharacter(s) in header z: )rc r r r r r �typer5 )r� Z header_partZheader_validator_indexZ validatorZ header_kindr9 r9 r: rC s
rC c C sF t | �\}}}}}}|s"|| }}|�dd�d }t|||||df�S )zW
Given a url remove the fragment and the authentication part.
:rtype: str
r: r rq r� )r �rsplitr )rg r re r_ r� r= r> r9 r9 r: �
urldefragauth& s
rG c C s\ t | jdd�}|dk rPt| jt�rPy|| j� W qX tk
rL td��Y qXX ntd��dS )zfMove file pointer back to its recorded starting position
so it can be read again on redirect.
rE Nz;An error occurred when rewinding request body for redirect.z+Unable to rewind request body for redirect.)rs �bodyrc �_body_positionr r0 r )�prepared_request� body_seekr9 r9 r: � rewind_body7 s
rL )F)F)N)T)r )j�__doc__r� �
contextlibrG rJ r4 r� r� �sysr} rN ry � collectionsr �pip._vendor.urllib3.utilr r r� r r �_internal_utilsr r r
r �compatr r
r r r r r r� r r r r r r r �cookiesr �
exceptionsr r r r �
structuresr r^ �where�DEFAULT_CA_BUNDLE_PATH�
DEFAULT_PORTSrx r2 r$ �platformr; r? rT rn rv r� �contextmanagerr r� r� r� r� r� r� r� r� r� r� r� r� r� � frozensetr� r� r� r� r� r� r� r� r r r r r! r% r* �encoder3 r4 r5 r9 r? rB rD rC rG rL r9 r9 r9 r: �<module> s� $
$ B
9%
#
( <
&