Highly logical, balancing respect for best practices with critical thinking Adaptable to new challenges Capable of independently delivering projects from start to finish Proficient in English communication.
General Computing Expertise: Unix environments, networking, distributed and cloud computing Python Frameworks and Tools: pip, pytest, boto3, pyspark, pylint, pandas, scikit-learn, keras Workflow Scheduling and Monitoring Tools: Apache Airflow, Luigi, AWS Batch Columnar and Big Data Databases: Athena, Redshift, Vertica, Hive/Hadoop Container Management and Orchestration: Docker, Docker Swarm, ECS, EKS/Kubernetes, Mesos CI/CD Tools: CircleCI, Jenkins, TravisCI, Spinnaker, AWS CodePipeline Distributed Messaging and Event Streaming Systems: Kafka, Pulsar, RabbitMQ, Google Pub/Sub Streaming Data Processing Frameworks: Spark Streaming, Apache Beam, Apache Flink General AWS or Cloud Services: Glue, EMR, EC2, ELB, EFS, S3, Lambda, API Gateway, IAM, Cloudwatch Version Control: Git commands, branching strategies, collaboration etiquette, documentation best practices Agile/Lean Methodologies: Scrum, Kanban Additional Skills (familiarity with any of the following is a plus):
JVM Languages and Frameworks: Kotlin, Java, Scala / Maven, Spring, Lombok, Spark, JDK Mission Control RDBMS and NoSQL Databases: MySQL, PostgreSQL / DynamoDB, Redis, HBase Enterprise BI Tools: Tableau, Qlik, Looker, Superset, PowerBI, Quicksight Data Science Environments: AWS Sagemaker, Project Jupyter, Databricks Log Ingestion and Monitoring: ELK stack (Elasticsearch, Logstash, Kibana), Datadog, Prometheus, Grafana Metadata Catalog and Lineage Systems: Amundsen, Databook, Apache Atlas, Alation, uMetric Data Privacy and Security Tools and Concepts: Tokenization, hashing and encryption algorithms, Apache Ranger If you feel that this position describes who you are, what you are looking, and you are urgently seeking a new role, we encourage you to apply right away!