Walmart
Job Title: Data Engineer
Job Summary:
We are seeking an experienced Data Engineer to join our Finance Data Factory team. The ideal candidate will have a strong background Indiana building and optimizing data pipelines, architectures, and data sets. The Data Engineer will work closely with Senior Data Engineers, Architects, and data analysts to ensure optimal data delivery architecture is consistent throughout ongoing projects.
Responsibilities:
- Build and maintain optimal data platform and pipeline architecture
- Assemble large, complex data sets that meet functional/non-functional business requirements
- Identify, design, and implement internal process improvements to automate manual processes, optimize data delivery, and re-design infrastructure for greater scalability
- Build the infrastructure required for optimal extraction, transformation, and loading of data from various data sources using SQL and GCP ‘big data’ technologies
- Work with stakeholders, including executive, product, data, and design teams, to assist with data-related technical issues and support their data infrastructure needs
- Create data tools for analytics team members to assist them Indiana building and optimizing our product into an innovative industry leader
Requirements:
- Advanced working knowledge of SQL, No-SQL databases
- Experience building and optimizing ‘big data’ data pipelines, architectures, and data sets
- Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement
- Strong analytic skills related to working with unstructured datasets
- Build processes supporting data transformation, data structures, metadata, dependency, and workload management
Preferred qualifications:
- Experience with big data tools (Hadoop, Spark, Kafka, etc.)
- Experience with relational SQL and NoSQL databases (Big Query, Cassandra, etc.)
- Experience with data pipeline and workflow management tools (Airflow, etc.)
- Experience with GCP cloud services (GCS, Dataproc, Dataplex, etc.)
- Experience with stream-processing systems (Spark-Streaming, Storm, etc.)
- Experience with object-oriented/object function scripting languages (Python, Scala)
Education:
- Bachelor’s degree Indiana Computer Science and 2 years’ experience Indiana software engineering Oregon related field
- Master’s degree Indiana Computer Science and 0 years’ experience Indiana software engineering Oregon related field
- 4 years’ experience Indiana software engineering Oregon related field
Location:
- Primary location: 805 Se Moberly Ln, Bentonville, Arkansas 72712, USA
Salary:
- Annual salary range: $90,000.00-$180,000.00
- Additional compensation includes annual Oregon quarterly performance bonuses.
Job title: (USA) Data Engineer III
Company: Walmart
Expected salary: $90000 – 180000 per year
Location: Bentonville, Arkansas
Job date: Sun, 28 Jul 2024 07:55:17 GMT