Databricks Subject Matter Expert

Description Subject Matter Expert – Data Engineering Job Summary B&A is seeking a highly experienced and mission-oriented Databricks Subject Matter Expert . We are seeking an independent, subject matter expert to lead and provide support for data collection, data validation, data visualization, and analytics. Our culture includes a highly entrepreneurial atmosphere within a well-established business. We value highly motivated, self-starters who thrive in a fast-paced environment.

Responsibilities

• Lead and provide expert support for data collection, data validation, data visualization, and analytics initiatives
• Apply disciplined methodologies for the planning, analysis, design, and development of information systems on an enterprise-wide basis or across a business sector
• Develop analytical techniques and methodologies to solve complex business and technical problems
• Perform strategic systems planning, business information planning, and business analysis
• Organize and analyze large volumes of structured and unstructured data sets using data analytical tools
• Locate, access, merge, clean, and standardize data from multiple sources, and develop derived metrics
• Create and implement data collection and analysis tools using programming languages such as Python, Databricks, SQL, Scala, R, and Java
• Design, script, debug, and analyze data engineering solutions
• Implement and create machine learning-based tools and processes
• Apply distributed and parallel processing technologies (e.g., Spark) to handle big data analytics tasks involving large data volumes
• Perform SQL Server data imports from CSV and TXT files
• Leverage Excel and Google Suite for data analysis, reporting, and collaboration
• Utilize supporting tools and platforms such as Pentaho (data import/transformation), Azure Data Studio, GitHub, and Smartsheet as needed
• Document task requirements, work completed, processes, and technical details thoroughly
• Communicate effectively with stakeholders across technical and business teams
• Operate independently as a subject matter expert in a fast-paced, entrepreneurial environment

Education And Experience

• Bachelor’s or master’s degree in computer science Computer Science, Data Science, Engineering, or a related field.
• This position requires a minimum of seven (7) years experience, of which at least three (3) years must be specialized.

Required Skills

• Knowledge in organizing and analyzing large amounts of structured and unstructured data sets using data analytical tools, to include experience locating, accessing, merging, cleaning, and standardizing data, and developing derived metrics.
• Strong proficiency in creating and implementing data collection and analysis tools while utilizing programming languages and environments, including Python, Databricks, SQL, Scala, R, and Java. Knowledge of design, scripting, debugging, and analysis.
• Experience in the implementation and creation of machine learning-based tools or processes.
• Knowledge in distributed & parallel processing (e.g., Spark) and the computational power required to handle most big data analytics tasks that can process large volumes of data.

Desired Skills

• Good facility with SQL Server data import from CSV files and TXT files
• Strong skills with Excel and Google Suite
• Familiarity with the following software packages and platforms are helpful: Pentaho for data import and transformation, Azure Data Studio, GitHub, and Smartsheet.
• Strong documentation and communication skills
• Documenting details of task requirements, work completed, etc.

Security Clearance

• Eligible to obtain a Public Trust Clearance.

More About B&A Notable Clients B&A has grown to be a company that is trusted by our clients for exceptional service, innovative solutions, and inspired employees. Our service extends through federal, state, and local Government, the private sector, and higher