Responsibilities

• Assist full-category data integration
• Participate in the ingestion and cleansing of CEX high-frequency data (e.g., order book, trade ticks), low-frequency market data (e.g., daily candlesticks, funding rates), on-chain foundational data (e.g., block information, token transfers), and macro data; interface with exchange APIs (e.g., Binance WebSocket, OKX REST) and blockchain nodes (e.g., Infura) to ensure data timeliness and accuracy.
• Maintain data ingestion scripts and tools, periodically troubleshoot interface stability issues (e.g., disconnections, data loss), and collaborate with the team to optimize ingestion pipeline latency (target: high-frequency data ingestion-to-storage latency < 1 second).
• Participate in high-performance database operations and optimization
• Assist in building and maintaining on-premise database clusters (e.g., ClickHouse, Redis); handle daily data writes, query monitoring, and basic optimizations (e.g., index tuning, partition strategies) to ensure high-throughput storage for high-frequency data (supporting tens of millions of daily writes).
• Contribute to the implementation of tiered time-series storage solutions (e.g., hot data in Redis, cold data archived to object storage) and work with the strategies team to tune SQL queries for improved efficiency.
• Support daily operations of the data platform
• Help build a data monitoring and alerting system (e.g., using Prometheus to track data latency and database load); respond rapidly to anomalies (e.g., data backlogs, query timeouts) and root-cause issues.
• Document data dictionaries and integration guides; provide the strategies team with foundational data query support (e.g., extracting historical order book snapshots) to lower the usage barrier.

Job Requirements

• Technical Foundation
• Approximately 3 years of database development or data engineering experience, including at least 1 year in high-frequency data processing or the crypto industry (e.g., interfacing with exchange APIs or on-chain data).
• Proficient in C++, capable of independently developing data ingestion services (e.g., WebSocket clients, Kafka producers); familiar with Python for writing data cleansing and validation scripts.
• Familiar with at least one high-performance database (e.g., ClickHouse, Redis) and skilled in basic write optimizations (e.g., batch writes) and query tuning (e.g., time-range filtering).
• Experience with message queues (e.g., Kafka) and a foundational understanding of stream processing frameworks (e.g., Flink); able to participate in simple data pipeline construction.
• Engineering Skills
• Basic Linux system administration skills; able to interpret system logs (e.g., CPU, memory, network I/O) and troubleshoot fundamental service deployment issues.
• Experience with version control (Git) and collaborative development; able to follow team coding standards.
• Soft Skills
• Strong learning ability; quick to grasp crypto data characteristics (e.g., perpetual contract rules, on-chain transaction structures).
• Clear communication skills; able to accurately understand and support the strategy team’s data requirements.

Preferred Qualifications

• Experience working in a quantitative trading team, crypto exchange, or market-maker data department.
• Familiarity with multiple mainstream CEX API details (e.g., Binance depth@100ms pushes, OKX incremental order book updates).
• Hands-on experience with Web3 tools (e.g., Web3.py, Ethers.js) to parse on-chain data (e.g., extracting ERC-20 transfer records).
• Involvement in ClickHouse cluster deployments or Kafka stream processing projects, with demonstrated cases of reducing data latency (e.g., cutting write latency from 2s to 500ms).