https://github.com/agladsoft/export_vsk_scripts

https://github.com/agladsoft/export_vsk_scripts

Repository

https://github.com/agladsoft/export_vsk_scripts/blob/master/

#  Export VSK Scripts

##   

          (  ).     :

-   Excel     
-      
-       
-       
-      JSON 
-    ClickHouse    

##   

```
export_vsk_scripts/
 Dockerfile                          #  
 requirements.txt                     # Python 
 bash_dir/                           # Bash   
    run_export_vsk.sh              #   
    flat_export_vsk.sh             #    VSK
 scripts/                           # Python 
     flat_export_vsk.py             #    
     parsed.py                      #    
```

##   

###  Python   
- **flat_export_vsk.py** -     Excel    
- **parsed.py** -         

###  Bash  
- **run_export_vsk.sh** -    
- **flat_export_vsk.sh** -     flat_export_vsk_tracking  flat_export_vsk_tracking_update

##  

###     VSK
1. **  Excel ** -      VSK
2. **  **:
   -    
   -        
   -       
   -    (//)
3. **   **:
   -      
   -       
   -      
   -     
4. **   **:
   -      ClickHouse
   -      
   -        
5. **   JSON** -   

###   
-     Excel 
-      3   
-     
-       

##   

       :

```bash
# ClickHouse 
HOST=clickhouse_host
DATABASE=database_name
USERNAME_DB=username
PASSWORD=password

#   
IP_ADDRESS_CONSIGNMENTS=service_ip
PORT=service_port

#   
XL_IDP_ROOT_VSK_EXPORT=/path/to/vsk/export/data
XL_IDP_PATH_VSK_EXPORT=/path/to/vsk/export/files

# Docker 
XL_IDP_PATH_DOCKER=/app/scripts
```

##    

###   

1. **  :**
```bash
git clone 
cd export_vsk_scripts
```

2. **   :**
```bash
python3 -m venv venv
source venv/bin/activate  # Linux/Mac
# 
venv\Scripts\activate     # Windows
```

3. **  :**
```bash
pip install -r requirements.txt
```

4. **   :**
```bash
cp .env.example .env
#  .env    
```

5. **  :**
```bash
#   
python3 scripts/flat_export_vsk.py /path/to/file.xlsx /path/to/output/

#   ( bash)
bash bash_dir/run_export_vsk.sh
```

###  Docker Compose ( )

          docker-compose :

```yaml
export_vsk:
  container_name: export_vsk
  restart: always
  ports:
    - "8095:8095"
  volumes:
    - ${XL_IDP_PATH_VSK_EXPORT_SCRIPTS}:${XL_IDP_PATH_DOCKER}
    - ${XL_IDP_ROOT_VSK_EXPORT}:${XL_IDP_PATH_VSK_EXPORT}
  environment:
    XL_IDP_ROOT_VSK_EXPORT: ${XL_IDP_PATH_DOCKER}
    XL_IDP_PATH_VSK_EXPORT: ${XL_IDP_PATH_VSK_EXPORT}
    IP_ADDRESS_CONSIGNMENTS: ${IP_ADDRESS_CONSIGNMENTS}
    XL_VSK_EXPORT: vsk
    TOKEN_TELEGRAM: ${TOKEN_TELEGRAM}
  build:
    context: export_vsk
    dockerfile: ./Dockerfile
    args:
      XL_IDP_PATH_DOCKER: ${XL_IDP_PATH_DOCKER}
  command: bash -c "sh ${XL_IDP_PATH_DOCKER}/bash_dir/run_export_vsk.sh"
  networks:
    - postgres
```

**     .env:**
```bash
#     
XL_IDP_PATH_VSK_EXPORT_SCRIPTS=/path/to/export_vsk_scripts
XL_IDP_ROOT_VSK_EXPORT=/path/to/vsk/export/data
XL_IDP_PATH_DOCKER=/app/scripts
XL_IDP_PATH_VSK_EXPORT=/app/data

#   
IP_ADDRESS_CONSIGNMENTS=service_ip
PORT=service_port

# Telegram 
TOKEN_TELEGRAM=your_bot_token

# ClickHouse  (   )
HOST=clickhouse_host
DATABASE=database_name
USERNAME_DB=username
PASSWORD=password
```

** :**
```bash
docker-compose up -d export_vsk
```

###   

- **Python**: 3.8+
- ****: Linux (), Windows, macOS
- ****:  2GB RAM
- ****:     
- ****:   ClickHouse    

##   

###    (Excel  VSK)
 :
- ** **: , , 
- ** **: , , , 
- ** **:  , , , 
- ** **: , TEU,  /, 
- ****: , , 
- ****: , 

###   
- **JSON ** -     
- ** **:
  -     
  -    
  -     
  -    

##    

###  
-   ClickHouse
-      
-    
-    API 

###   
-      "error_"
-      ( 3 )
-    API  (120 )
-     

##    

###     
1.   Python    `scripts/`
2.     `flat_export_vsk.sh`
3.   `DirsArray`   

###  
```bash
#   
python3 scripts/flat_export_vsk.py test_file.xlsx output/

#    ClickHouse
python3 -c "from scripts.parsed import clickhouse_client; clickhouse_client()"

#   
python3 -c "from scripts.parsed import ParsedDf; import pandas as pd; df = pd.DataFrame([{'line': 'MSC', 'container_number': 'TEST123', 'direction': 'export'}]); ParsedDf(df).get_port()"
```

##    

   :
- **flat_export_vsk_tracking** -     
- **flat_export_vsk_tracking_update** -   

  :
- **done/** -     
- **json/** -    JSON 
- **error_*** -    

##   

  :
1.    
2.     ClickHouse
3.       
4.        
5.       

##  

    .

Owner

GitHub Events

Issues and Pull Requests

Last synced: 10 months ago