Responsibilities: 1. Drive the platformization, componentization, and tooling capabilities of the general-purpose web crawler platform. 2. Lead the architecture design, technical optimization, and core feature development of the distributed crawler platform. 3. Abstract the processes of data collection, parsing, cleaning, deduplication, distribution, and storage into reusable components and implement visual, low-code configuration. 4. Bypass anti-scraping mechanisms, optimize crawler routing and scheduling strategies, and design and refine anti-scraping defenses. 5. Monitor crawler health and data quality to ensure stability, reliability, timeliness, and accuracy. Requirements: 1. Bachelor’s degree or higher in Computer Science or a related field, with a solid theoretical foundation and mastery of common data structures and algorithms. 2. At least 5 years of Java development experience; strong core Java skills, familiar with multithreading and NIO, and in-depth understanding and application of common design patterns. 3. Proficiency with Spring, Spring Boot, Spring MVC, Struts, and MyBatis. 4. Deep understanding of distributed technologies and their internal implementation principles; hands-on experience with middleware such as Kafka, Redis, Dubbo, and Elasticsearch. 5. Excellent analytical and problem-solving skills; a passion for tackling challenging issues; strong team spirit and a high sense of responsibility.