Spark data jobs
Apache Spark splits work on very large datasets across many machines. Data teams use its DataFrame API and Spark SQL for batch pipelines that clean, join and aggregate data, and Structured Streaming for data that arrives continuously. It runs on Databricks, Amazon EMR, Google Dataproc and Kubernetes.
Data engineers are the main roles naming it, writing and tuning jobs: partitioning, avoiding expensive shuffles, handling skewed data and reading the Spark UI when a job is slow. Data scientists use PySpark for features and analysis on data too large for pandas. Expect Python or Scala, SQL, Databricks, Delta Lake or Iceberg, and Airflow. We count Apache Spark, PySpark, Spark SQL or Streaming, Spark jobs, clusters and pipelines, and Spark in a list of tools, since spark on its own is an everyday word.
1,765 open data roles at 783 employers, from their own job boards. Showing the newest 100.
Follow Spark202 new this week
- Sr Data ScientistHILL-ROM COMPANY, INC. USA · Bangalore, Karnataka · 2 locations9 h ago
- Principal Data EngineerStrider Technologies · Tysons Corner, VA9 h ago
- Data Engineer, CapTech Sports (Fan, Consumer, Brand & Media Data)CapTech Consulting · Atlanta, GA, United States · 2 locations10 h ago
- Data Engineer, CapTech Sports (Competition Data)CapTech Consulting · Atlanta, GA, United States · 2 locations10 h ago
- Sr. Data DeveloperEsri · Redlands, CAup to $167K · 10 h ago
- Senior Data EngineerVericast · San Antonio, TX, United Statesup to $150K · 11 h ago
- Principal Data Scientist - Advanced AnalyticsVericast · San Antonio, TX, United Statesup to $200K · 11 h ago
- Cloud Data Infrastructure EngineerClickHouse · NAMER and LatAm; Canadaup to $230K · 11 h ago
- Data Analytics Viz DeveloperAccenture Federal Services · Washington, DCup to $203K · 11 h ago
- Data Analytics Data EngineerAccenture Federal Services · Washington, DCup to $203K · 11 h ago
- Manager, Data Engineering, Trust & SafetyOpenAI · San Franciscoup to $536K · 12 h ago
- Staff Data EngineerSaronic Technologies · Austin, TX13 h ago
- Senior Data EngineerEncora · Campinas · 2 locations13 h ago
- Principal Data Engineer, Global SecurityAbbVie · North Chicago, IL, United States15 h ago
- Lead Data Engineer - Plateforme Skywise (H/F)ALTEN · Toulouse, Occitanie, France16 h ago
- Data Lead - Financial ServicesCapco · Poland - Warsaw17 h ago
- Data Analyst (Big Data)Similarweb · Prague17 h ago
- Data Engineer gyakornokBosch Group · Budapest, Hungary17 h ago
- Senior Data Platform Engineer (Infra)Riskified · Lisbon20 h ago
- Data Scientist 2Microsoft · Hyderabad, TS, IN20 h ago
- Data EngineerCity of New York · New York City, NY, United States21 h ago
- DataOps Engineer (m/f/d)Redcare Pharmacy · Cologne, NRW, Germany22 h ago
- DATA ENGINEER JAVA SPARK H/FInetum · Nantes, France22 h ago
- AWS Data EngineerCapco · India - Bengaluru23 h ago
- Data AnalystInter IKEA Group · Älmhult, Sweden1 days ago
- Senior AI & Data EngineerBosch Group · bangalore, India1 days ago
- Consultant Data Engineer Databricks (H/F)ALTEN · Lyon, Auvergne-Rhône-Alpes, France1 days ago
- Senior PySpark Developer with Mainframe - Tieto Tech Consulting (m/f/d)Tieto · Bangalore, India1 days ago
- Senior Data Scientist, Decision ModelsMcKesson Canada Corporation / La Corporation McKesson Canada · Corkup to €108K · 1 days ago
- Data ScientistBooz Allen Hamilton_United States · Arlington, VA · 22 locationsup to $225K · 1 days ago
- Data Analytics Intern – Summer 2027Enact Mortgage Insurance Corporation · Richmond, Virginiaup to $26/h · 1 days ago
- Senior Data Scientist, AI EnablementBloomberg Industry Group, Inc. · Arlington, VA - 1801 S Bell (INDG)up to $180K · 1 days ago
- Data Scientist--JIATFCACI, INC.-FEDERAL · Alexandria, VA, USup to $238K · 1 days ago
- Data Engineer, SpecialistThe Vanguard Group, Inc. · 4 Locations · 4 locations1 days ago
- Sr. Data EngineerArlo Technologies, Inc. · Milpitas, CAup to $160K · 1 days ago
- Senior AWS Data Lake ArchitectSemtech_Advanced_Systems_India_Private_Ltd_v2 · IND - Hyderabad1 days ago
- Data Engineering and Analytics ManagerBloomberg Industry Group, Inc. · Arlington, VA - 1801 S Bell (INDG)up to $195K · 1 days ago
- Lead Data Architect, ModelerEnact Mortgage Insurance Corporation · 2 Locationsup to $187K · 1 days ago
- Senior BI DeveloperAllstate Insurance Company of Canada - Permanent · Mexico (Remote)1 days ago
- Data Scientist, Machine LearningTrinity Partners, LLC · 3 Locations · 3 locations1 days ago
- Data ScientistFIS INC (OLD FIS) · 3 Locations1 days ago
- Lead Data ScientistTransUnion LLC · Chicago, Illinoisup to $188K · 1 days ago
- Data ScientistLEIDOS, INC. · Odenton, MD · 3 locationsup to $210K · 1 days ago
- Director, Data ScienceIntegral Ad Science, Inc. · 2 Locationsup to $320K · 1 days ago
- IAR Senior Data AnalystWGU Corporation · Salt Lake City, UT1 days ago
- Principal Data ScientistCoca-Cola Properties, LLC · US - GA - Atlanta1 days ago
- Analytics EngineerOmnidian · Bangaloreup to $38K · 1 days ago
- Data EngineerAcuityMD · Boston or Remoteup to $159K · 1 days ago
- Senior Tableau Developer / BI AnalystCodeRoad · Latin America1 days ago
- Senior Data Scientist, ResearchAlpaca · Remote - Americas1 days ago
- Senior Data Scientist | AI H/FInetum · SAINT OUEN, France1 days ago
- Senior Data EngineerTTEC Digital · At Home - Colombia1 days ago
- Cientista de Dados Especialista - Modelagem de CréditoiFood · Brasil1 days ago
- Senior Data Scientist (R14369)Oportun · Remote - India1 days ago
- Senior Data Scientist, Model Risk Management (R14365)Oportun · Remote - India1 days ago
- Staff Data Scientist - Global Search, ConsumerDelivery Hero · Berlin, Germany1 days ago
- Teknisk konsulent - Utvikler eller Data EngineerSopra Steria · Tromsø, Troms, Norway1 days ago
- Data Architect/Data Engineering LeadEndava · Belgrade, Central Serbia, Serbia · 5 locations1 days ago
- Data EngineerSopra Steria · Bergen, Vestland, Norway · 3 locations1 days ago
- Senior Data Engineer – Azure & DatabricksInetum · Brussels, Brussels, Belgium1 days ago
- Senior Data EngineerNielsenIQ · Ciudad de México, DIF, Mexico · 2 locations1 days ago
- Staff Data Engineer - Fintech Engineering (m/f/n)InPost · Warsaw/Cracow, Poland1 days ago
- Senior Data Engineer - Fintech Engineering (m/f/n)InPost · Warsaw/Cracow, Poland1 days ago
- Data Analytics Consultant (m/f/n)InPost · Warszawa, Województwo mazowieckie, Poland1 days ago
- Data Scientist IV (6393)itD Tech · San Jose1 days ago
- Data ScientistSigmoid · Bengaluru, Karnataka, India1 days ago
- Ingénieur Data Senior – GCP (F/H) - Services Financiers - Ile-de-FranceSopra Steria · Paris, IDF, France1 days ago
- Senior Databricks Engineer - Tieto Tech Consulting Poland (m/f/d)Tieto · Kraków, Lesser Poland Voivodeship, Poland · 6 locations1 days ago
- Data Engineer Databricks senior H/FInetum · SAINT-OUEN-SUR-SEINE, France1 days ago
- Associate Lead Data Scientist (RGM)Sigmoid · Bengaluru, Karnataka, India2 days ago
- Data Engineer IILantern · Dallas, TX - Hybrid (3x in office/week)2 days ago
- Data Engineer II, Stores Security- Healthcare SecurityAmazon · Austin, Texas, USA2 days ago
- Data ScientistTorch Technologies, Inc. · Colorado Springs, CO · 2 locationsup to $115K · 2 days ago
- Senior Manager - Data EngineeringBloom Energy · Bangalore, Karnataka2 days ago
- Data Scientist – Safety Analytics (Python/Databricks)GM do Brasil Ltda · Warren, Michigan, United States of America2 days ago
- Data Engineer II, WW Promotions Data and InsightsAmazon · Vancouver, British Columbia, CAN2 days ago
- Data Engineer IIIExpedia, Inc. · India - Bangalore · 2 locationsup to €78K · 2 days ago
- Senior BI DeveloperABC Fitness Solutions, LLC · Hyderabad Office, India.2 days ago
- Senior Data Analyst - Trading and Markets 100% (f/m/d) - (Contract through our external payroll partner, immediate start for 12 months, possible extension)CH10 - BJB Bank Julius Baer & Co. Ltd. · Zurich2 days ago
- Lead Databricks ArchitectFractal Analytics UK Limited · Toronto2 days ago
- DATA SCIENTISTHOME DEPOT MANAGEMENT COMPANY, LLC · STORE SUPPORT CENTER, ATLANTA - 9090up to $180K · 2 days ago
- Senior Director, Software Engineering – Data PlatformTempus AI, Inc. · 2 Locationsup to $270K · 2 days ago
- IT Data Engineer I INTTyson IT solutions India Pvt Ltd · Bangalore, India2 days ago
- Data Engineer II, Global Logistics, ExportsAmazon · Bellevue, Washington, USA2 days ago
- Data & AI Analytics InternIMAGE FRAME INVESTMENT (UK) LIMITED · Singapore-CapitaSky2 days ago
- Senior Data ScientistSam's East, Inc. · Hoboken, NJ · 4 locationsup to $234K · 2 days ago
- Robotics Data Engineer / Data ScientistGM do Brasil Ltda · Warren, Michigan, United States of Americaup to $132K · 2 days ago
- Principal Associate, Data Scientist (Deep Learning)Capital One · Plano, TXup to $168K · 2 days ago
- WeChat - Data & AI Analytics InternIMAGE FRAME INVESTMENT (UK) LIMITED · Singapore-CapitaSky2 days ago
- Lead Data Scientist (Causal Inference/Experimentation)Allstate Insurance Company of Canada - Permanent · US - Remote2 days ago
- Senior Analyst, Business IntelligenceHorizon Media LLC · New York, New Yorkup to $115K · 2 days ago
- Sr. Lead Data ScientistEarly Warning Services, LLC · 4 Locationsup to $200K · 2 days ago
- Senior. Data Scientist, Customer Experience and Channel InnovationAetna Resources, LLC · Work At Home-Rhode Islandup to $204K · 2 days ago
- Software Engineer II, Data Platform (Hybrid, London)CrowdStrike, Inc. · United Kingdom - London2 days ago
- Senior Analysts, Data Science & AnalyticsTransUnion LLC · White Plains, New York2 days ago
- Senior ML Data Platform Engineer | $165K-$175K + Hybrid + Equity | AI Powered Outage Intelligence SaaS StartupPhillyTech.Co · King of Prussia, PA, United States2 days ago
- Principal Data EngineerNielsenIQ · Mexico City, MEX, Mexico2 days ago
- Data Solutions ArchitectToradex · Campinas, São Paulo, Brazil2 days ago
- Sr. Software Engineer, Data EngineeringPoshmark · US California (Redwood City) - Officeup to $194K · 2 days ago
- Lead Data ScientistScout Motors · Charlotte, North Carolina, United Statesup to $193K · 2 days ago