File: //opt/alt/python37/lib/python3.7/site-packages/ssa/__pycache__/db.cpython-37.pyc
B
V�dZ
� @ s� d dl Z d dlZd dlZd dlmZmZ d dlmZmZmZm Z m
Z
m Z m Z m
Z
d dlmZ d dlmZ d dlmZ dZdZe� ZG d d
� d
e�Zd d � Zd
d� Zdd� Zdd� Zdd� Z ddd�Z ej ed�dd��Z dS ) � N)�datetime� timedelta)�Column�Boolean�DateTime�Integer�String�
create_engine�event�func)�declarative_base)� Inspector)�Sessionz/var/lve/ssa.db� c @ s� e Zd ZdZdZeedd�Zeeddd�Z eeddd�Z
eedd�Z eedd�Z ee
dd�Zee
dd�Zeedd�Zeedd�Zee
dd�Zeedd�e�� d �Zeedd�e�� e�� d
�Zd S ) �
RequestResultay
Describes processed request stored in database file.
E.g.
{
"timestamp": "1650008727",
"url": "http://mydomain.com/index.php",
"duration": 162077,
"hitting_limits": false,
"throttled_time": 0,
"io_throttled_time": 0,
"wordpress": true
}
Note: created_at, updated_at is saved in local TZ format
Z
scrape_resultT)Z primary_keyF)�index�nullable)r )�timezone)�server_default)Zonupdater N)�__name__�
__module__� __qualname__�__doc__Z
__tablename__r r �idr �domain�path� timestamp�durationr Zis_slow_requestZhitting_limitsZthrottled_timeZio_throttled_timeZ wordpressr r �now�
created_atZ
updated_at� r r �7/opt/alt/python37/lib/python3.7/site-packages/ssa/db.pyr " s r c C sD t �� ttd� }t| �� }|�t��tj|k �� � W dQ R X dS )zD
Removes outdated records from database, saving disk space.
)�daysN)
r �todayr �RETENTION_TIME_DAYS�
session_scope�queryr �filterr �delete)�engine�
n_days_ago�sessionr r r! �cleanup_old_dataG s
r, c C s t | �stj�| � d S )N)�
is_db_present�Base�metadataZ
create_all)r) r r r! �create_db_if_not_existR s r0 c C s8 t j�t�sdS t�| �}dd� |�� D �}t|�dkS )NFc S s g | ]}|�qS r r )�.0�tabler r r! �
<listcomp>[ s z!is_db_present.<locals>.<listcomp>r )�osr �isfile�SSA_DBr
Z from_engineZget_table_names�len)r) Zdatabase_inspectionZtablesr r r! r- W s
r- c C s | � d� d S )NzPRAGMA journal_mode = WAL)�execute)Z dbapi_conZ
con_recordr r r! �setup_wal_mode_ s r9 c sL dt � �� | r� � d�� � fdd�}td|dd�}t�|dt� t|� |S ) Nzfile:z?mode=roc s t j� dd�S )NT)�uri)�sqlite3�connectr )�connection_stringr r! �<lambda>g � z!_setup_database.<locals>.<lambda>z sqlite:////F)�creator�echor< )r6 r r
�listenr9 r0 )�readonlyr@ r) r )r= r! �_setup_databasec s
rD Fc C s t | �S )N)rD )rC r r r! �setup_databasep s rE )�returnc c sH t | d�}z.y|V |�� W n |�� � Y nX W d|�� X dS )zF
Provide a transactional scope around a series of operations.
)�bindN)r ZcommitZrollback�close)r) r+ r r r! r% t s
r% )F) r4 �
contextlibr; r r Z
sqlalchemyr r r r r r r
r Zsqlalchemy.ext.declarativer Z sqlalchemy.engine.reflectionr
Zsqlalchemy.ormr r6 r$ r. r r, r0 r- r9 rD rE �contextmanagerr% r r r r! �<module>
s& ( %