File: //opt/osm/venv/lib64/python3.10/site-packages/charset_normalizer/__pycache__/models.cpython-310.pyc
o
=ij0 � @ s� d dl mZ d dlmZ d dlmZ d dlmZ d dlm Z d dl
m Z m Z m
Z
mZ ddlmZmZ dd lmZmZmZ G d
d � d �ZG d d
� d
�Zeeef Ze
e ZG dd� d�Z dS )� )� annotations)�aliases)�sha256)�dumps)�sub)�Any�Iterator�List�Tuple� )� RE_POSSIBLE_ENCODING_INDICATION�TOO_BIG_SEQUENCE)� iana_name�is_multi_byte_encoding�
unicode_rangec @ sH e Zd Z dGdHdd�ZdIdd�ZdIdd�ZedJdd��ZdKdd�ZdKd d �Z dLd d �Z
edKd!d"��Z edMd$d%��Z edNd&d'��Z
edNd(d)��ZedMd*d+��ZedKd,d-��ZedJd.d/��ZedJd0d1��ZedJd2d3��ZedJd4d5��ZedOd6d7��ZedPd9d:��ZedNd;d<��ZedMd=d>��ZedMd?d@��ZdQdRdCdD�ZedKdEdF��ZdS )S� CharsetMatchN�payload�bytes�guessed_encoding�str�mean_mess_ratio�float�has_sig_or_bom�bool� languages�CoherenceMatches�decoded_payload�
str | None�preemptive_declarationc C sL || _ || _|| _|| _|| _d | _g | _d| _d | _d | _ || _
|| _ d S )N� ) �_payload� _encoding�_mean_mess_ratio�
_languages�_has_sig_or_bom�_unicode_ranges�_leavesZ_mean_coherence_ratio�_output_payload�_output_encoding�_string�_preemptive_declaration)�selfr r r r r r r � r, �G/opt/osm/venv/lib/python3.10/site-packages/charset_normalizer/models.py�__init__ s
zCharsetMatch.__init__�other�object�returnc C s> t |t�st |t�rt|�| jkS dS | j|jko | j|jkS )NF)�
isinstancer r r �encoding� fingerprint�r+ r/ r, r, r- �__eq__* s
zCharsetMatch.__eq__c C s� t |t�st�t| j|j �}t| j|j �}|dk r%|dkr%| j|jkS |dk r@|dkr@t| j�tkr:| j|jk S | j |j kS | j|jk S )zQ
Implemented to make sorted available upon CharsetMatches items.
g{�G�z�?g{�G�z�?)
r2 r �
ValueError�abs�chaos� coherence�lenr r
�multi_byte_usage)r+ r/ Zchaos_differenceZcoherence_differencer, r, r- �__lt__1 s
zCharsetMatch.__lt__c C s dt t| ��t | j� S )Ng �?)r; r �raw�r+ r, r, r- r< G s z CharsetMatch.multi_byte_usagec C s" | j d u rt| j| jd�| _ | j S )N�strict)r) r r r! r? r, r, r- �__str__K s
zCharsetMatch.__str__c C s d| j � d| j� d�S )Nz<CharsetMatch 'z' bytes(z)>)r3 r4 r? r, r, r- �__repr__Q s zCharsetMatch.__repr__�Nonec C s8 t |t�r || krtd�|j���d |_| j�|� d S )Nz;Unable to add instance <{}> as a submatch of a CharsetMatch)r2 r r7 �format� __class__r) r& �appendr5 r, r, r- � add_submatchT s ��zCharsetMatch.add_submatchc C � | j S �N)r! r? r, r, r- r3 _ � zCharsetMatch.encoding� list[str]c C sD g }t �� D ]\}}| j|kr|�|� q| j|kr |�|� q|S )z�
Encoding name are known by many name, using this could help when searching for IBM855 when it's listed as CP855.
)r �itemsr3 rF )r+ Z
also_known_as�u�pr, r, r- �encoding_aliasesc s
�z CharsetMatch.encoding_aliasesc C rH rI �r$ r? r, r, r- �bomp rJ zCharsetMatch.bomc C rH rI rP r? r, r, r- �byte_order_markt rJ z CharsetMatch.byte_order_markc C s dd� | j D �S )z�
Return the complete list of possible languages found in decoded sequence.
Usually not really useful. Returned list may be empty even if 'language' property return something != 'Unknown'.
c S s g | ]}|d �qS )r r, )�.0�er, r, r- �
<listcomp>~ � z*CharsetMatch.languages.<locals>.<listcomp>�r# r? r, r, r- r x s zCharsetMatch.languagesc C sp | j s1d| jv r
dS ddlm}m} t| j�r || j�n|| j�}t|�dks+d|v r-dS |d S | j d d S )z�
Most probable language found in decoded sequence. If none were detected or inferred, the property will return
"Unknown".
�asciiZEnglishr )�encoding_languages�mb_encoding_languagesz Latin Based�Unknown)r# �could_be_from_charsetZcharset_normalizer.cdrY rZ r r3 r; )r+ rY rZ r r, r, r- �language� s
��zCharsetMatch.languagec C rH rI )r" r? r, r, r- r9 � rJ zCharsetMatch.chaosc C s | j sdS | j d d S )Nr r r rW r? r, r, r- r: � s zCharsetMatch.coherencec C � t | jd dd�S �N�d � )�ndigits)�roundr9 r? r, r, r- �
percent_chaos� � zCharsetMatch.percent_chaosc C r^ r_ )rc r: r? r, r, r- �percent_coherence� re z CharsetMatch.percent_coherencec C rH )z+
Original untouched bytes.
)r r? r, r, r- r> � s zCharsetMatch.raw�list[CharsetMatch]c C rH rI )r& r? r, r, r- �submatch� rJ zCharsetMatch.submatchc C � t | j�dkS �Nr )r; r& r? r, r, r- � has_submatch� s zCharsetMatch.has_submatchc C s@ | j d ur| j S dd� t| �D �}ttdd� |D ���| _ | j S )Nc S s g | ]}t |��qS r, )r )rS �charr, r, r- rU � rV z*CharsetMatch.alphabets.<locals>.<listcomp>c S s h | ]}|r|�qS r, r, )rS �rr, r, r- � <setcomp>� rV z)CharsetMatch.alphabets.<locals>.<setcomp>)r% r �sorted�list)r+ Zdetected_rangesr, r, r- � alphabets� s
zCharsetMatch.alphabetsc C s | j gdd� | jD � S )z�
The complete list of encoding that output the exact SAME str result and therefore could be the originating
encoding.
This list does include the encoding available in property 'encoding'.
c S s g | ]}|j �qS r, )r3 )rS �mr, r, r- rU � s z6CharsetMatch.could_be_from_charset.<locals>.<listcomp>)r! r& r? r, r, r- r\ � s z"CharsetMatch.could_be_from_charset�utf_8r3 c s~ � j du s
� j |kr<|� _ t� �}� jdur5� j�� dvr5tt� fdd�|dd� dd�}||dd� }|�|d�� _� jS ) z�
Method to get re-encoded bytes payload using given target encoding. Default to UTF-8.
Any errors will be simply ignored by the encoder NOT replaced.
N)zutf-8�utf8rs c s< | j | �� d | �� d � �| �� d t� j��dd��S )Nr r �_�-)�string�span�replace�groupsr r( )rr r? r, r- �<lambda>� s
�z%CharsetMatch.output.<locals>.<lambda>i r )�country )r( r r* �lowerr r �encoder' )r+ r3 �decoded_stringZpatched_headerr, r? r- �output� s
�
�
zCharsetMatch.outputc C s t | �� ��� S )zw
Retrieve the unique SHA256 computed using the transformed (re-encoded) payload. Not the original one.
)r r� � hexdigestr? r, r, r- r4 � s zCharsetMatch.fingerprint)NN)r r r r r r r r r r r r r r )r/ r0 r1 r )r1 r �r1 r )r/ r r1 rC )r1 rK �r1 r )r1 r )r1 rg )rs )r3 r r1 r ) �__name__�
__module__� __qualname__r. r6 r= �propertyr< rA rB rG r3 rO rQ rR r r] r9 r: rd rf r> rh rk rq r\ r� r4 r, r, r, r- r
sX �
r c @ sb e Zd ZdZd d dd�Zd d d
�Zd!dd�Zd"dd�Zd#dd�Zd$dd�Z d%dd�Z
d%d d �Z dS )&�CharsetMatchesz�
Container with every CharsetMatch items ordered by default from most probable to the less one.
Act like a list(iterable) but does not implements all related methods.
N�results�list[CharsetMatch] | Nonec C s |r t |�| _d S g | _d S rI )ro �_results)r+ r� r, r, r- r. � s zCharsetMatches.__init__r1 �Iterator[CharsetMatch]c c s � | j E d H d S rI �r� r? r, r, r- �__iter__� s �zCharsetMatches.__iter__�item� int | strr c C sJ t |t�r
| j| S t |t�r#t|d�}| jD ] }||jv r"| S qt�)z�
Retrieve a single item either by its position or encoding name (alias may be used here).
Raise KeyError upon invalid index or encoding not present in results.
F)r2 �intr� r r r\ �KeyError)r+ r� �resultr, r, r- � __getitem__ s
�zCharsetMatches.__getitem__r� c C s
t | j�S rI �r; r� r? r, r, r- �__len__ s
zCharsetMatches.__len__r c C ri rj r� r? r, r, r- �__bool__ s zCharsetMatches.__bool__rC c C s| t |t�std�t|j����t|j�tk r0| j D ]}|j
|j
kr/|j |j kr/|� |� dS q| j �
|� t| j �| _ dS )z~
Insert a single match. Will be inserted accordingly to preserve sort.
Can be inserted as a submatch.
z-Cannot append instance '{}' to CharsetMatchesN)r2 r r7 rD r rE r; r> r
r� r4 r9 rG rF ro )r+ r� �matchr, r, r- rF s
��
� zCharsetMatches.append�CharsetMatch | Nonec C s | j sdS | j d S )zQ
Simply return the first match. Strict equivalent to matches[0].
Nr r� r? r, r, r- �best) s
zCharsetMatches.bestc C s | � � S )zP
Redundant method, call the method best(). Kept for BC reasons.
)r� r? r, r, r- �first1 s zCharsetMatches.firstrI )r� r� )r1 r� )r� r� r1 r )r1 r� r� )r� r r1 rC )r1 r� ) r� r� r� �__doc__r. r� r� r� r� rF r� r� r, r, r, r- r� � s
r� c @ s. e Zd Zddd�Zeddd��Zd dd�ZdS ) �CliDetectionResult�pathr r3 r rO rK �alternative_encodingsr] rq r r r9 r r: � unicode_path� is_preferredc C sF || _ |
| _|| _|| _|| _|| _|| _|| _|| _| | _ | | _
d S rI ) r� r� r3 rO r� r] rq r r9 r: r� ) r+ r� r3 rO r� r] rq r r9 r: r� r� r, r, r- r. = s
zCliDetectionResult.__init__r1 �dict[str, Any]c C s2 | j | j| j| j| j| j| j| j| j| j | j
d� S )N� r� r3 rO r� r] rq r r9 r: r� r� r� r? r, r, r- �__dict__W s �zCliDetectionResult.__dict__c C s t | jddd�S )NT� )� ensure_ascii�indent)r r� r? r, r, r- �to_jsong s zCliDetectionResult.to_jsonN)r� r r3 r rO rK r� rK r] r rq rK r r r9 r r: r r� r r� r )r1 r� r� )r� r� r� r. r� r� r� r, r, r, r- r� < s
r� N) �
__future__r Zencodings.aliasesr �hashlibr �jsonr �rer �typingr r r r
Zconstantr r
�utilsr r r r r� r r ZCoherenceMatchr r� r, r, r, r- �<module> s i C