https://github.com/agladsoft/export_scripts

https://github.com/agladsoft/export_scripts

Repository

https://github.com/agladsoft/export_scripts/blob/master/

#  Export Scripts

##   

           NUTEP  NLE.     :

-   Excel     
-        
-       
-       
-      JSON 
-    ClickHouse    
-    Telegram   

##   

```
export_scripts/
 Dockerfile                          #  
 requirements.txt                     # Python 
 venv/                               #   Python
 bash_dir/                           # Bash   
    _nutep_lines.sh                #     NUTEP
    _nle_lines.sh                  #     NLE
    flat_export.sh                 #   
    export_grain.sh                #   
    report_order.sh                #    
    report_orders_update.sh        #   
 scripts/                           # Python 
     __init__.py                    #  
     flat_export.py                #   
     export_grain.py               #   
     report_order.py               #    
     report_orders_update.py       #   
     parsed.py                     #    
```

##   

###  Python   
- **flat_export.py** -     Excel    
- **export_grain.py** -      
- **report_order.py** -     
- **report_orders_update.py** -    
- **parsed.py** -         

###  Bash  
- **_nutep_lines.sh** -      NUTEP
- **_nle_lines.sh** -     NLE ( flat_export)
- **flat_export.sh** -    
- **export_grain.sh** -   
- **report_order.sh** -    
- **report_orders_update.sh** -   

##  

###     

####    (flat_export)
1. **  Excel ** -     
2. **  **:
   -    
   -        
   -       
   -    (//)
3. **   **:
   -      
   -       
   -      
   -     

####    (export_grain)
1. **    **:
   -     
   -      
   -    
   -      
2. **   **:
   -   
   -     

####     (report_order)
1. **   **:
   -      
   -      
   -     
2. **   (report_orders_update)**:
   -     
   -    

###   

####  NUTEP Terminal
-    :  ,  ,   
-    
-       

####  NLE Terminal  
-     
-     

###   
-     Excel 
-      3-60  (   )
-     
-       
-  Telegram    

##   

       :

```bash
# ClickHouse 
HOST=clickhouse_host
DATABASE=database_name
USERNAME_DB=username
PASSWORD=password

#   
IP_ADDRESS_CONSIGNMENTS=service_ip
PORT=service_port

#   
XL_IDP_ROOT_EXPORT=/path/to/export/data
XL_IDP_PATH_EXPORT=/path/to/export/files

#  (nutep  nle)
XL_IMPORT_TERMINAL=nutep_or_nle

# Telegram 
TOKEN_TELEGRAM=your_bot_token
CHAT_ID=your_chat_id
TOPIC=your_topic
ID=your_message_id

# Docker 
XL_IDP_PATH_DOCKER=/app/scripts
```

##    

###   

1. **  :**
```bash
git clone 
cd export_scripts
```

2. **   :**
```bash
python3 -m venv venv
source venv/bin/activate  # Linux/Mac
# 
venv\Scripts\activate     # Windows
```

3. **  :**
```bash
pip install -r requirements.txt
```

4. **   :**
```bash
cp .env.example .env
#  .env    
```

5. **  :**
```bash
#     
python3 scripts/flat_export.py /path/to/file.xlsx /path/to/output/

#    
python3 scripts/export_grain.py /path/to/file.xlsx /path/to/output/

#    NUTEP ( )
export XL_IMPORT_TERMINAL=nutep
bash bash_dir/_nutep_lines.sh

#    NLE ( flat_export)
export XL_IMPORT_TERMINAL=nle
bash bash_dir/_nle_lines.sh
```

###  Docker Compose ( )

          docker-compose    :

####   NUTEP ( 8090)
```yaml
export_nutep:
  container_name: export_nutep
  restart: always
  ports:
    - "8090:8090"
  volumes:
    - ${XL_IDP_PATH_EXPORT_SCRIPTS}:${XL_IDP_PATH_DOCKER}
    - ${XL_IDP_ROOT_EXPORT}:${XL_IDP_PATH_EXPORT}
  environment:
    XL_IDP_ROOT_EXPORT: ${XL_IDP_PATH_DOCKER}
    XL_IDP_PATH_EXPORT: ${XL_IDP_PATH_EXPORT}
    IP_ADDRESS_CONSIGNMENTS: ${IP_ADDRESS_CONSIGNMENTS}
    XL_IMPORT_TERMINAL: nutep
    TOKEN_TELEGRAM: ${TOKEN_TELEGRAM}
  build:
    context: export
    dockerfile: ./Dockerfile
    args:
      XL_IDP_PATH_DOCKER: ${XL_IDP_PATH_DOCKER}
  command: bash -c "sh ${XL_IDP_PATH_DOCKER}/bash_dir/_nutep_lines.sh"
  networks:
    - postgres
```

####   NLE ( 8091)
```yaml
export_nle:
  container_name: export_nle
  restart: always
  ports:
    - "8091:8091"
  volumes:
    - ${XL_IDP_PATH_EXPORT_SCRIPTS}:${XL_IDP_PATH_DOCKER}
    - ${XL_IDP_ROOT_EXPORT}:${XL_IDP_PATH_EXPORT}
  environment:
    XL_IDP_ROOT_EXPORT: ${XL_IDP_PATH_DOCKER}
    XL_IDP_PATH_EXPORT: ${XL_IDP_PATH_EXPORT}
    IP_ADDRESS_CONSIGNMENTS: ${IP_ADDRESS_CONSIGNMENTS}
    XL_IMPORT_TERMINAL: nle
    TOKEN_TELEGRAM: ${TOKEN_TELEGRAM}
  build:
    context: export
    dockerfile: ./Dockerfile
    args:
      XL_IDP_PATH_DOCKER: ${XL_IDP_PATH_DOCKER}
  command: bash -c "sh ${XL_IDP_PATH_DOCKER}/bash_dir/_nle_lines.sh"
  networks:
    - postgres
```

**     .env:**
```bash
#     
XL_IDP_PATH_EXPORT_SCRIPTS=/path/to/export_scripts
XL_IDP_ROOT_EXPORT=/path/to/export/data
XL_IDP_PATH_DOCKER=/app/scripts
XL_IDP_PATH_EXPORT=/app/data

#   
IP_ADDRESS_CONSIGNMENTS=service_ip
PORT=service_port

# Telegram 
TOKEN_TELEGRAM=your_bot_token
CHAT_ID=your_chat_id
TOPIC=your_topic
ID=your_message_id

# ClickHouse  (   )
HOST=clickhouse_host
DATABASE=database_name
USERNAME_DB=username
PASSWORD=password
```

** :**
```bash
#   NUTEP
docker-compose up -d export_nutep

#   NLE
docker-compose up -d export_nle

#   
docker-compose up -d export_nutep export_nle
```

###   

- **Python**: 3.8+
- ****: Linux (), Windows, macOS
- ****:  2GB RAM
- ****:     
- ****:   ClickHouse    

##   

###   

####    (Excel )
- ** **: , ,  , 
- ** **:  , , , 
- ** **:  , TEU, 
- ****: , , 
- ****:  ,  
- ****: ,  

####   
- ** **: 
- ****: , , 
- ** **:  ,   
- ****:  , ,  

####    
- ** **:  ,  
- ** **:  , , 
- ** **:    

###   
- **JSON ** -     
- ** **:
  -     
  -    
  -     
  -    
  -   

##    

###  NUTEP Terminal
- **lines_nutep/flat_export_nutep_tracking** -     
- **lines_nutep/flat_export_nutep_tracking_update** -   
- **export_grain/flat_export_grain** -   
- **report_orders/flat_report_orders** -   
- **report_orders_update/flat_report_orders_update** -  

###  NLE Terminal
- **lines_nle/flat_export_nle_tracking** -     
- **lines_nle/flat_export_nle_tracking_update** -   

  :
- **done/** -     
- **json/** -    JSON 
- **error_*** -    

##    

###  
-   ClickHouse
-      
-       
-    API 

###  Telegram 
-    
-      
-     

###   
-      "error_"
-      ( 3 )
-       (3-60 )
-     
-       

##    

###     
1.   Python    `scripts/`
2.   bash   `bash_dir/`
3.     `_nutep_lines.sh`  `_nle_lines.sh`
4.       

###  
```bash
#   
python3 scripts/flat_export.py test_file.xlsx output/

#   
python3 scripts/export_grain.py test_grain_file.xlsx output/

#    
python3 scripts/report_order.py test_report.xlsx output/

#    ClickHouse
python3 -c "from scripts.parsed import clickhouse_client; clickhouse_client()"

#   
python3 -c "from scripts.parsed import ParsedDf; import pandas as pd; df = pd.DataFrame([{'line': 'MSC', 'container_number': 'TEST123', 'direction': 'export'}]); ParsedDf(df).get_port()"
```

###     
```bash
#    NUTEP ( )
export XL_IMPORT_TERMINAL=nutep

#    NLE ( flat_export)
export XL_IMPORT_TERMINAL=nle
```

##   

  :
1.       
2.     ClickHouse
3.       
4.           
5.       
6.      Excel     
7.     XL_IMPORT_TERMINAL   

##  

    .

Owner

GitHub Events