alohe15/mle-portfolio
GitHub: alohe15/mle-portfolio
基于 IEEE-CIS 数据集构建的端到端电商欺诈检测机器学习系统,涵盖数据处理、特征工程、模型训练与 FastAPI 部署的完整流程。
Stars: 0 | Forks: 0
# MLE 作品集
用于 IEEE-CIS 欺诈检测的端到端机器学习项目:包含数据准备、特征工程、模型训练、评估和提供服务的 API。
## 项目结构
```
mle-portfolio/
├── configs/ # Hyperparameters, feature lists, paths (edit settings without code changes)
├── data/
│ ├── raw/ # Competition CSVs and archives (gitignored)
│ └── processed/ # Merged and featured parquet files (gitignored)
├── docs/ # Session logs and write-ups
├── evals/ # Cross-version comparisons and evaluation artifacts
├── models/ # Trained model files and per-run metrics (gitignored)
├── notebooks/ # Exploratory analysis scripts
├── scripts/ # Pipeline: merge → features → train
├── services/ # FastAPI inference service
├── tests/ # API integration and latency checks
└── requirements.txt # Pinned dependencies
```
## 环境设置
```
python -m venv .venv
source .venv/bin/activate
pip install -r requirements.txt
```
将原始的 IEEE-CIS 数据放在 `data/raw/` 目录下(参见 Kaggle 竞赛文件)。
## Pipeline
在仓库根目录下运行:
```
python scripts/merge_train_data.py
python scripts/feature_engineering.py
python scripts/train_baseline_lightgbm.py
python scripts/train_engineered_lightgbm.py
python evals/compare_models.py
```
## 提供预测服务
```
uvicorn services.api.app:app --reload --app-dir .
python tests/test_api_endpoint.py
```
## 配置
训练超参数、特征工程设置和文件路径位于 `configs/` 目录下:
- `configs/training.json` — 划分比例、决策阈值、LightGBM 参数
- `configs/feature_engineering.json` — 空值阈值、频率编码列
- `configs/paths.json` — 数据和模型产物位置
标签:Apex, AV绕过, FastAPI, LightGBM, 反欺诈检测, 数据工程, 机器学习, 模型部署, 逆向工具