the smart solution for Silver Spring jobs

BigData/Spark Developer

Company: The Silicon Partners Inc.
Location: Silver Spring
Posted on: December 9, 2018

Job Description:

Position Title: BigData/Spark Developer With AWS Division: Global Technology & OperationsLocation: Silver Spring, MDDepartment: Global Data AnalyticsReports to: Sr. Manager - Data EngineeringLong Term ContractThe Role The BigData/Spark Engineer should be a technical contributor who has hands-on knowledge of all phases in building large-scale cloud based distributed data processing systems and applications. You will be part of the Global Data & Analytics engineering technology team and will partner closely with a team of data scientists, business analysts & data engineers leading Discovery's cloud based Big Data & Analytics strategy.You'll work on implementing complex AWS based big data projects with a focus on collecting, parsing, managing, analyzing and visualizing large sets of data to turn information into insights using multiple technology platforms. Therefore, this role requires an understanding of how a secure big data cloud environment is architected to gain real insights faster, with less friction and complexity. The Sr. data engineer should be passionate about working with cutting edge technologies in solving problems and developing prototypes using different open source tools for the selected solutions.You'll need to be an innovative forward-thinker who will help lead end-to-end execution of data engineering initiatives and contribute directly to existing and emerging business strategies and goals. Creativity, Attention to detail and ability to work in a collaborative team environment are essential.The AWS/BigData Engineer will work closely with the Data Engineering Manager to decide on needed infrastructure architecture and software design needs and act according to the decisions. Key Areas of Responsibility

  • Lead the design, implementation, and continuous delivery of pipelines using distributed AWS based big data technologies supporting data processing initiatives across batch and streaming datasets
  • Responsible for development using Scala , Python languages and Big Data Frameworks such as Spark, EMR, Presto, AWS Athena, Kafka, and Kinesis
  • Provide administrative support on deployed AWS platform components
  • Identify, evaluate and implement cutting edge big data pipelines and frameworks required to provide requested capabilities to integrate external data sources and APIs
  • Review, analyses and evaluate market requirements, business requirements and project briefs in order to design the most appropriate end-to-end technology solutions
  • Process and manage high volume real time customer interaction streams
  • Provide architectural support by building Proof of Concepts & Prototypes
  • Self-Starter to deliver data engineering solutions to optimize both the cost and existing solution
  • Stay current with emerging technologies and industry trendsRequired Qualifications
    • Bachelor's Degree or higher in Computer Sciences or similar
    • Minimum of 5-6 years Software Industry experience
    • 3+ years of development experience with AWS services Must have EC2, EMR , RedShift, Data Pipeline or Airflow, S3, Cloud Formation and CLI (must to have ) and Jenkins
    • 4+ years of development experience with Apache Spark, Presto, SQL and NoSQL Implementation
    • 5+ years of extensive working knowledge in different programming Scala ( Must ), Shell and Python (Must).
    • Proficiency working with structured, semi-structured and unstructured data sets including social, web logs and real time streaming data feeds
    • Able to tune Big Data solutions to improve performance and end-user experience
    • Knowledge on Visualization and Data Science Tools.
    • Expert level usage with Jenkins, GitHub is preferred
    • Spark developer / AWS Developer certification is a plus
    • Ability and eagerness to constantly learn and teach others.
    • Experience in the media industry is a plus. - provided by Dice Big data, Hadoop, AWS, EC2, Redshift(RDS), elastic mapreduce(EMR), Data Pipeline, S3, CLI, Scala, Python, airflow, GIT, Jenkins,zookeeper,kafka, Spark, Java

      Keywords: The Silicon Partners Inc., Silver Spring , BigData/Spark Developer, IT / Software / Systems , Silver Spring, Maryland

      Click here to apply!

      Didn't find what you're looking for? Search again!

      I'm looking for
      in category

Other IT / Software / Systems Jobs

Software Innovation SETA Support Engineer (Military Veterans Wanted!)
Description: Description JOB DESCRIPTION: SAIC has an immediate opening for Software Innovation SETA Support Engineer to provide systems engineering and technical advisory services. JOB RESPONSIBILITIES: Job responsibilities (more...)
Company: SAIC
Location: Chantilly
Posted on: 12/19/2018

Entry Level Software Engineer - Harrisburg
Description: Revature is the fastest growing employer of emerging technology talent in the US and we are currently looking to hire over 100 new Software Engineers. Our Software Engineers design, analyze and build (more...)
Company: Revature
Location: Harrisburg
Posted on: 12/19/2018

Technical Acquistion Support Analyst (Military Veterans Wanted!)
Description: Description The Advanced Plans Acquisition Support Engineer requires a detailed understanding of government satellite systems acquisitions. The position requires an ability to assist the customer with (more...)
Company: SAIC
Location: Chantilly
Posted on: 12/19/2018

Software Engineer (Military Veterans Wanted!)
Description: Description Job Description: br Release Train Engineer RTE to lead planning, integration, and execution of software development within a Scaled Agile Framework environment SAFe . The candidate should (more...)
Company: SAIC
Location: Chantilly
Posted on: 12/19/2018

Software Developer - Backend/Node JS NO Clearance Req'd
Description: Job Description:Software Engineer for a mission critical program in Chantilly, VA. The Software Engineer will provide technical expertise in backend development
Company: Leidos
Location: Chantilly
Posted on: 12/19/2018

CNO/CNE Sr Principal Software Engineer with Security Clearance
Description: Raytheon, a leader in CNO/CNE, is seeking quality Senior Software Engineers to develop and enhance mission critical enterprise or departmental IT systems, from project inception to completion. These positions (more...)
Company: Raytheon
Location: Chantilly
Posted on: 12/19/2018

Spacecraft Flight Software Engineer (Military Veterans Wanted!)
Description: Description SAIC is looking for a cleared, Spacecraft Flight Software Engineer, with technical expertise in spacecraft Flight Software FSW development. ul li S L provides technical and programmatic (more...)
Company: SAIC
Location: Chantilly
Posted on: 12/19/2018

Junior SharePoint Developer with Security Clearance
Description: Junior SharePoint Developer-- Location: Chantilly, VA Clearance:--U.S. Citizenship must be clearable to Public Trust level Position Description/Duties-- Consult with project teams and end users to (more...)
Company: Abbtech Professional Resources, Inc
Location: Chantilly
Posted on: 12/19/2018

Technical Analyst WMD, Sr Principal (Military Veterans Wanted!)
Description: Description JOB DESCRIPTION: ul li Our Technical Analysts will review laboratory reports and prepare technical assessments and foreign intelligence FI reports in support of a weapons of mass destruction (more...)
Company: SAIC
Location: Chantilly
Posted on: 12/19/2018

Software Developer - Backend Node JS - No Clearance Req'd-Chantilly, V
Description: Job Description: br br Leidos is seeking a Software Engineer/Developer for a mission critical program in Chantilly, VA. The Software Engineer/Developer will provide technical expertise in backend (more...)
Company: Leidos
Location: Chantilly
Posted on: 12/19/2018

Log In or Create An Account

Get the latest Maryland jobs by following @recnetMD on Twitter!

Silver Spring RSS job feeds