File: //lib/python3.6/site-packages/S3/__pycache__/BaseUtils.cpython-36.pyc
3
�9pe�( � / @ sN d dl mZmZ d dlZd dlZd dlZd dlZd dlmZ d dl m
Z
d dl m Z m
Z
mZ d dlZd dljjZddlmZ y d dlZW n4 ek
r� ejjd� ejj � ej e� Y nX yd d l m Z W n ek
r� d d l m Z Y nX ye!Z!W n e"k
�r e#Z!Y nX g Z$eZ%e$j&d
� y
e
� W n\ e'k
�r� Z( z>y e
d d � ej)e
d d �Z
W n e*k
�rz e(�Y nX W Y ddZ([(X nX e$j&d
� ej+d�Z,ej+dej-�Z.dd� Z/e$j&d� dd� Z0e$j&d� dd� Z1e$j&d� dd� Z2e$j&d� dd� Z3e$j&d� d?d d �Z4e$j&d � d@d d �Z5e$j&d � dAd d!�Z6e$j&d!� dBd"d#�Z7e$j&d#� dCd%d&�Z8e$j&d&� dDd'd(�Z9e$j&d(� dEd)d*�Z:e$j&d*� d+d,� Z;e$j&d,� d-d.� Z<e$j&d.� d/d0� Z=e$j&d0� d1d2� Z>e$j&d2� d3d4� Z?e$j&d4� d5d6� Z@e$j&d6� d7d8� ZAe$j&d8� d9d:� ZBe$j&d:� d;d<� ZCe$j&d<� d=d>� ZDe$j&d>� dS )F� )�absolute_import�divisionN)�timegm)�md5)�debug�warning�error� )� EX_OSFILEa*
!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
ImportError trying to import dateutil.parser.
Please install the python dateutil module:
$ sudo apt-get install python-dateutil
or
$ sudo yum install python-dateutil
or
$ pip install python-dateutil
!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
)�quote�s3pathF)Zusedforsecurityr z\.[0-9]*(?:[Z\-\+]*?)s9 ^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=['"](https?://[^'"]+)['"]c C s t jd| �} tjj| dd�S )Nz.000T)�fuzzy)�RE_S3_DATESTRING�sub�dateutil�parser�parse)�date� r � /usr/lib/python3.6/BaseUtils.py�dateS3toPythonX s r c C s t t| �j� �S )N)r r � utctimetuple)r r r r � dateS3toUnix_ s r c C s t jj| dd�S )zW
Convert a string formatted like '2020-06-27T15:56:34Z' into a python datetime
T)r
)r r r )r r r r �dateRFC822toPythone s r c C s t t| �j� �S )N)r r r )r r r r �dateRFC822toUnixm s r c C s t jj| dd�}|jd�S )NT)r
z%Y-%m-%d %H:%M)r r r Zstrftime)Z s3timestampZdate_objr r r �formatDateTimer s r �UTF-8�replacec C sV t | �tkr| S |s$td| |f � y t| ||�S tk
rP td| ��Y nX dS )z<
Convert 'string' to Unicode or raise an exception.
zUnicodising %r using %sz Conversion to unicode failed: %rN)�type�unicoder �UnicodeDecodeError)�string�encoding�errors�silentr r r �base_unicodise{ s r% c C sV t | �tkr| S |s$td| |f � y | j||�S tk
rP td| ��Y nX dS )z�
Convert unicode 'string' to <type str>, by default replacing
all invalid characters with '?' or raise an exception.
zDeUnicodising %r using %sz"Conversion from unicode failed: %rN)r r r �encode�UnicodeEncodeError)r! r" r# r$ r r r �base_deunicodise� s r( c C s t | d|d�S )zE
Convert S3 UTF-8 'string' to Unicode or raise an exception.
zUTF-8T)r% )r! r# r r r �decode_from_s3� s r) c C s t | d|d�S )z
Convert Unicode to S3 UTF-8 'string', by default replacing
all invalid characters with '?' or raise an exception.
zUTF-8T)r( )r! r# r r r � encode_to_s3� s r* Tc C s< |r
d}nd}t | �} t| |d�} |r0t| �} nt | �} | S )a�
URI encode every byte. UriEncode() must enforce the following rules:
- URI encode every byte except the unreserved characters: 'A'-'Z', 'a'-'z', '0'-'9', '-', '.', '_', and '~'.
- The space character is a reserved character and must be encoded as "%20" (and not as "+").
- Each URI encoded byte is formed by a '%' and the two-digit hexadecimal value of the byte.
- Letters in the hexadecimal value must be uppercase, for example "%1A".
- Encode the forward slash character, '/', everywhere except in the object key name.
For example, if the object key name is photos/Jan/sample.jpg, the forward slash in the key name is not encoded.
�~z~/)�safe)r* r r) )ZparamZquote_backslashes�unicode_outputZ
safe_charsr r r �s3_quote� s
r. c C sH t | �} |dkr| S t| dd�}td| |f � |r<t|�S t |�S d S )NZverbatimz~/)r, zString '%s' encoded to '%s')r* r r r) )r! Zurlencoding_moder- Zencodedr r r �base_urlencode_string� s r/ c C s� d}d}x`| D ]X}t |�}|dkrD|dtt d�| � 7 }|d7 }q|dkr^|d7 }|d7 }q||7 }qW |r�|r�td ||f � |S )
z�
replace_nonprintables(string)
Replaces all non-printable characters 'ch' in 'string'
where ord(ch) <= 26 with ^@, ^A, ... ^Z
� r � �^�@r � z^?z+%d non-printable characters replaced in: %s)�ord�chrr )r! Z with_messageZ
new_stringZmodified�c�or r r �base_replace_nonprintables� s
r9 c C s� g }x|| D ]t}i }x\|D ]T}t |j�}t|�r>t|g�||< q|jd|j �}|d k rdt |�||< qd ||< qW |r
|j|� q
W |S )Nz.//%s)r) �tag�len�
parseNodes�findtext�append)�nodesZretval�nodeZ retval_item�child�nameZ
found_textr r r r< � s
r< c C s t jjj| �}|j� S )N)�xmlZdomZminidomZ parseStringZ toprettyxml)ZxmlstrZ xmlparserr r r �getPrettyFromXml s rD c C s4 t j| �}|r(|jd�}t jd| d�} nd}| |fS )zy
removeNameSpace(xml) -- remove top-level AWS namespace
Operate on raw byte(utf-8) xml string. (Not unicode)
� s \1\2r N)�RE_XML_NAMESPACE�match�groupr )rC Z xmlns_match�xmlnsr r r �stripNameSpace s
rJ c C sh t t| ��\} }y tj| �}|r*||jd< |S tk
rb } ztd|� t| � � W Y d d }~X nX d S )NrI zError parsing xml: %s)rJ r* �ETZ
fromstringZattrib� Exceptionr )rC rI �tree�er r r �getTreeFromXml s
rO c C s t | �}|jd| �}t|�S )Nz.//%s)rO �findallr< )rC r@ rM r? r r r �getListFromXml- s rQ c C s� i }x�| D ]~}t |�r t|�}n|jd k r4t|j�nd }t|j�}||kr|t|| �tksh|| g||< || j|pvd� q
|p�d||< q
W |S )Nr0 )r; �getDictFromTree�textr) r: r �listr> )rM Zret_dictrA ZcontentZ child_tagr r r rR 4 s
rR c C sN t | �}|jj|�r,|jd k r(t|j�S d S |j|�}|d k rFt|�S d S d S )N)rO r: �endswithrS r) r= )rC ZxpathrM �resultr r r �getTextFromXmlG s
rW c C s t | �}|jd k r t|j�S d S )N)rO r: r) )rC rM r r r �getRootTagNameQ s rX c C s t j| �}t|�|_|S )N)rK ZElementr) rS )�tag_namerS �elr r r � xmlTextNodeW s
r[ c C s t | |�}|j|� |S )z�
Creates a new <tag_name> Node and sets
its content to 'text'. Then appends the
created Node to 'parent' element if given.
Returns the newly created Node.
)r[ r> )rY rS �parentrZ r r r �appendXmlTextNode^ s
r] )r r F)r r F)r )r )TF)NF)F)EZ
__future__r r � functools�re� posixpath�sysZcalendarr Zhashlibr Zloggingr r r Zxml.dom.minidomrC Zxml.etree.ElementTreeZetreeZ ElementTreerK Z ExitCodesr
Zdateutil.parserr � ImportError�stderr�write�flush�exitZurllibr Z urllib.parser � NameError�str�__all__r r> �
ValueError�exc�partialrL �compiler � MULTILINErF r r r r r r% r( r) r* r. r/ r9 r< rD rJ rO rQ rR rW rX r[ r] r r r r �<module>
s�