Azure Data Engineer

Job Location(s) US
Posted Date 3 months ago(10/25/2022 4:51 PM)
Job ID
# of Openings
Technology Experts - Technical Consultant



We currently have a career opportunity for an [JOB TITLE] to join our team located in [LOCATION].


Job Overview:


As a Lead Technical Consultant you will participate in all aspects of the software development lifecycle which includes estimating, technical design, implementation, documentation, testing, deployment and support of application developed for our clients. As a member working in a team environment you will work with solution architects and developers on interpretation/translation of wireframes and creative designs into functional requirements, and subsequently into technical design.


Perficient is always looking for the best and brightest talent and we need you! We’re a quickly-growing, global digital consulting leader, and we’re transforming the world’s largest enterprises and biggest brands. You’ll work with the latest technologies, expand your skills, and become a part of our global community of talented, diverse, and knowledgeable colleagues.



  • Work with data engineering team to define and develop data ingestion, validation, transformation, and data engineering code.
  • Develop open-source platform components using Hadoop, Spark, Scala, Java, Oozie, Hive and other components
  • Deliver on cloud platforms and integrate with services such as Azure Data Factory, ADLS, Azure DevOps, Azure Functions, Synapse
  • Document code artifacts and participate in developing user documentation and run books
  • Troubleshoot deployment to various environments and provide test support.
  • Participate in design sessions, demos, and prototype sessions, testing and training workshops with business users and other IT associates



    • At least 3+ years of experience in developing large scale data processing/data storage/data distribution systems, preferably Databricks
    • At least 3+ years of experience on working with large Hadoop projects using Spark and Python and working with Spark DataFrame, Dataset APIs with SparkSQL as well as RDDs and Scala function literals and closures.
    • Hands-on experience with Hadoop, Hive, Sqoop, Oozie, HDFS.  Great SQL Skills. 
    • Experience with ELT/ETL development, patterns and tooling is recommended
    • Experience with Azure cloud environments
    • Experience with SQL including Postgres, MySQL RDBMS platforms
    • Experience with Linux (RHEL or Centos preferred) environments.
    • Experience with various IDE and code repositories as well as unit testing frameworks.
    • Experience with code build tools such as Maven.
    • Fundamental knowledge of distributed data processing systems and storage mechanisms.
    • Ability to produce high quality work products under pressure and within deadlines with specific references
    • Strong communication and collaborative skills
    • At least 5+ years of working with large multi-vendor environment with multiple teams and people as a part of the project
    • At least 5+ years of working with a complex Big Data environment
    • 5+ years of experience with JIRA/GitHub/Git and other code management toolsets

    Preferred Skills and Education:

    • Bachelors’ degree in Computer Science or related field
    • Certification in Spark, Databricks, Azure or other cloud platform

Perficient full-time employees receive complete and competitive benefits. We offer a collaborative work environment, competitive compensation, generous work/life opportunities and an outstanding benefits package that includes paid time off plus holidays. In addition, all colleagues are eligible for a number of rewards and recognition programs including billable bonus opportunities. Encouraging a healthy work/life balance and providing our colleagues great benefits are just part of what makes Perficient a great place to work. 



Perficient is a leading global digital consultancy. We imagine, create, engineer, and run digital transformation solutions that help our clients exceed customers’ expectations, outpace competition, and grow their business. With unparalleled strategy, creative, and technology capabilities, our colleagues bring big thinking and innovative ideas, along with a practical approach to help our clients – the world’s largest enterprises and biggest brands succeed.



At Perficient, we promise to challenge, champion, and celebrate our people. You will experience a unique and collaborative culture that values every voice. Join our team, and you’ll become part of something truly special.


We believe in developing a workforce that is as diverse and inclusive as the clients we work with. We’re committed to actively listening, learning, and acting to further advance our organization, our communities, and our future leaders… and we’re not done yet.


Perficient, Inc. proudly provides equal employment opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, gender, sexual orientation, national origin, age, disability, genetic information, marital status, amnesty, or status as a protected veteran in accordance with applicable federal, state and local laws. Perficient, Inc. complies with applicable state and local laws governing non-discrimination in employment in every location in which the company has facilities. This policy applies to all terms and conditions of employment, including, but not limited to, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation, and training. Perficient, Inc. expressly prohibits any form of unlawful employee harassment based on race, color, religion, gender, sexual orientation, national origin, age, genetic information, disability, or covered veterans. Improper interference with the ability of Perficient, Inc. employees to perform their expected job duties is absolutely not tolerated.


Disability Accommodations:


Perficient is committed to providing a barrier-free employment process with reasonable accommodations for qualified individuals with disabilities and disabled veterans in our job application procedures. If you need assistance or accommodation due to a disability, please contact us.



Disclaimer:  The above statements are not intended to be a complete statement of job content, rather to act as a guide to the essential functions performed by the employee assigned to this classification.  Management retains the discretion to add or change the duties of the position at any time. 



Sorry the Share function is not working properly at this moment. Please refresh the page and try again later.
Share on your newsfeed

Need help finding the right job?

We can recommend jobs specifically for you! Click here to get started.