Introduction

Dependency

• python 3.x
• apscheduler
• beautifulsoup4
• dbutils
• pymysql
• pyquery
• requests

Use

Init the database tables

TODO

Crawl the fund list (brief)

python crawl_fund_list.py

Crawl the fund list (detailed)

python crawl_fund_info.py

Crawl the history data of all funds

python crawl_fund_history.py

Crawl the latest data of all funds

python crawl_fund_latest.py