大数据开发
25-40K
大数据开发 25-40K
上海
本科
经验不限
发布于 12月25日 BOSS直聘
职位描述
SparkKafkahadoop
Responsibilities工作职责:
-Understanding business requirement, responsible on big data product design and development for big data products of connected vehicle;
根据需求,负责网联汽车大数据服务产品开发和设计,大数据产品的流/批处理代码设计和开发;
-Participant in data warehouse project, responsible on data warehouse schema design, ETL code design and development;
参与数据仓库项目,负责数据仓库表结构设计、ETL程序的设计和开发;
-Assist algorithm engineer in data preprocessing, feature extraction, algorithm of model code implementation and deployment on cloud platform;
协助算法工程师对数据进行预处理、特征提取、云端算法模型的代码实现和上线部署;
-Participant in cloud architecture design for big data product, and investigation of new technologies related to big data, promote the continuously improvement and optimization of the product and service;
参与云端大数据产品架构设计和大数据相关新技术调研,推动产品及服务持续地改进和优化;
-Close cooperation with development teams.
与团队的密切合作。
Requirements任职要求:
-Full-time bachelor or master degree in computer, software engineering related majors or having more than 2 years related work experience;
全日制本科或以上学历,计算机、软件工程相关专业或具有2年以上的相关工作经验;
-Familiar with Hadoop、Hive、HBase、Spark、Kafka、Presto and other big data component technology, having theoretical knowledge and practical experience on related components;
熟悉Hadoop、Hive、HBase、Spark、Kafka、Presto等大数据组件技术,具备相关组件的理论知识和实践经验;
-Rich database use or design experience, familiar with MySQL, MongoDB, Redis, etc;
有丰富的数据库使用或设计经验,熟悉MySQL、MongoDB、Redis等;
-Experience in data warehouse and big data platform design and development is preferred;
有数据仓库设计和大数据平台设计开发工作经验者优先;
-Experience in Ali DataWorks, HUAWEI DataArts Studio is preferred;
有阿里云DataWorks、华为云DataArts
工作地址
上海徐汇区星瀚广场星瀚广场
相似职位推荐