Luboš is available for hire
Hire LubošLuboš Charčenko
Verified Expert in Engineering
Python Developer
Location
Brno, South Moravian Region, Czech Republic
Toptal Member Since
September 21, 2022
Lubos是一名Python开发人员和熟练的解决方案架构师，拥有8年以上领导高负载系统开发团队的经验. He's also worked as a founding engineer and chief architect at the startup, Kiwi.com. Lubos excels at MVPs, distributed systems, performance optimization, web scraping, and APIs and has extensive experience with large database clusters like PostgreSQL, Elastic, and Cassandra. Lubos is driven by the philosophy, "Do it with passion or don't do it at all."
Portfolio
Fintech Company
Python, ScyllaDB, Apache Kafka, Datadog, PagerDuty, TensorFlow, Keras, Pandas...
Kiwi
Python, Node.js, JavaScript, Git, Jira, Flask, ScyllaDB, Docker, Kubernetes...
Kiwi
PostgreSQL, Apache Cassandra, Apache Kafka, RabbitMQ, ScyllaDB, Kubernetes...
Experience
Availability
Part-time
Preferred Environment
Python, Linux, Git, Docker, Amazon Web Services (AWS)
The most amazing...
...product I've created is Nomad at Kiwi.com. It's a unique travel search tool for planning multi-city trips, scanning every travel combination for the best price.
Work Experience
Founder
2021 - PRESENT
Fintech Company
- Developed a pipeline for consuming and storing all ticks from the US stock market, which consisted of around 1 million messages per second.
- 建立了一个管道来准备各种不同的机器学习数据集，用于训练和测试神经网络.
- 实验了许多神经网络架构类型，并开发了基于卷积神经网络(CNN)和强化学习(RL)的交易策略。.
- 开发了一个交易代理，可以评估预测算法的结果，并在必要时每天重新分配投资组合.
Technologies: Python, ScyllaDB, Apache Kafka, Datadog, PagerDuty, TensorFlow, Keras, Pandas, NumPy, Celery, WebSockets, Docker, Kubernetes, Redis, GitLab CI/CD, Git, Flask, REST APIs, NoSQL, Convolutional Neural Networks (CNN), Back-end Development, Architecture, Data Structures, Automation, Back-end, AWS Cloud Architecture, Linux, Software Architecture, GitLab, Distributed Architecture, DevOps, Machine Learning, Deep Reinforcement Learning, Requests, Regular Expressions, Amazon EC2, Amazon Simple Notification Service (Amazon SNS), TensorBoard, Jupyter, CSS, HTML, APIs, Amazon Web Services (AWS), API Integration, Data Science, Bash
Chief Automation Officer
2020 - 2020
Kiwi
- Managed the COVID-19 crisis to minimize the pandemic's impact on the company.
- 优化取消预订的管理，并带领团队在极短的时间内开发全自动退款.
- Created the departmental strategy followed by reorganization.
- 根据投资回报(ROI)设置优先级和项目审查指南.
- Handled cross-department and department-to-top-management communication.
Technologies: Python, Node.js, JavaScript, Git, Jira, Flask, ScyllaDB, Docker, Kubernetes, Pandas, NumPy, SciPy, Vault, NoSQL, Web Scraping, Scraping, Back-end Development, Architecture, Data Structures, Relational Data Mapping, Automation, Back-end, AWS Cloud Architecture, Linux, GitLab CI/CD, GitLab, Distributed Architecture, DevOps, REST APIs, Datadog, PagerDuty, Redis, Machine Learning, SQLAlchemy, Google Cloud Platform (GCP), Agile, Proxy Servers, Regular Expressions, Proxies, Amazon EC2, TensorBoard, Jupyter, Chrome, CSS, HTML, Puppeteer, APIs, Amazon Web Services (AWS), Data Science, Software as a Service (SaaS), Technical Leadership, Technical Project Management
Chief Architect
2015 - 2020
Kiwi
- Established the technical direction for the core teams.
- Migrated search team services to Docker and created CI/CD pipeline for building, testing, and deployment to AWS.
- Led the evolution of a search engine through multiple technologies, including AWS Redshift, Elastic, Cassandra, ScyllaDB, and a custom C++ in-memory database.
- 在搜索api中实现Asyncio，从而更均匀地利用资源.
- Led the service migration to AWS, resulting in a hybrid architecture that used the best of both worlds; bare metal for services needing raw computation power and AWS for those needing security, scalability, elasticity, and availability.
- Invented the Nomad product from idea to production, a unique travel search tool for planning trips to multiple destinations. Nomad会在一个多城市的旅行中寻找每一个可能的旅行组合，以找到尽可能低的价格.
- 创建了一个10人的团队，开发了一个名为Tequila的B2B平台，所有这些都在10周内完成.
- Served as the main point of contact for impossible problems.
Technologies: PostgreSQL, Apache Cassandra, Apache Kafka, RabbitMQ, ScyllaDB, Kubernetes, Docker, Agile, Software Architecture, AWS Cloud Architecture, Python, Redshift, Node.js, JavaScript, GitLab CI/CD, Asyncio, Google Cloud Platform (GCP), Jira, Git, SQLAlchemy, Flask, Vault, Requests, Rancher, Memcached, NoSQL, Elasticsearch, DevOps, Web Scraping, Scraping, Back-end Development, Data Structures, Architecture, Relational Data Mapping, Automation, Back-end, Linux, GitLab, Distributed Architecture, REST APIs, Datadog, PagerDuty, Redis, Proxy Servers, Beautiful Soup, Regular Expressions, Proxies, Amazon EC2, Chrome, CSS, HTML, Puppeteer, APIs, Amazon Web Services (AWS), Localization, API Integration, Software as a Service (SaaS), Technical Leadership, Bash, Technical Project Management, Scrapy
Founding Developer | Co-owner
2013 - 2015
Kiwi
- Laid down the technology foundation for future growth and development.
- 基于高度优化的PostgreSQL集群，创建了搜索引擎的第一个高性能版本, 将航班组合成虚拟行间，能够进行高复杂度的大范围搜索.
- 开发一个安全的预订API，包括实现服务，如支付提供商或反欺诈解决方案.
- 设计并开发了一个定制的分布式模块化网页抓取系统，该系统采用复杂的抓取规划算法.
- 开发了一个数据管道，可以根据复杂的业务规则合并来自多个数据源的数据，在将飞行数据存储到数据库之前对其进行预处理.
- 设计并构建了一个模块化系统，用于通过航空公司网站处理预订和预订后的自动化, APIs, and global distribution systems (GDS).
- Onboarded, mentored, and led a team of new developers.
Technologies: Python, PostgreSQL, MongoDB, Redis, NGINX, Flask, Django, SQL, Git, Linux, JavaScript, Ansible, Agile, Software Architecture, Requests, MySQL, DevOps, Web Scraping, Scraping, Back-end Development, Architecture, Data Structures, Relational Data Mapping, Automation, Back-end, Distributed Architecture, REST APIs, Datadog, PagerDuty, SQLAlchemy, Memcached, Proxy Servers, Beautiful Soup, Regular Expressions, Proxies, Jinja, Podio, APIs, Localization, API Integration, Technical Leadership, PostGIS, Bash, Technical Project Management, Scrapy
Full-stack Developer
2013 - 2013
Colectora Software
- Developed the front- and back-end functionality for customer support, which monitored who was working, how long, 在哪些案件上加上它还限制了权限一次只有一个探员可以打开某些案件.
- 从Jira和Git创建自定义的自动化周报，以自动监控进度并估计功能的成本.
- Deployed and implemented the DevOps of my own applications.
Technologies: PHP, JavaScript, SQL, Linux, NGINX, Jira, APIs, WebSockets, Git, MySQL, DevOps, Agile, Back-end Development, Data Structures, Back-end, CSS, HTML, Amazon Web Services (AWS), API Integration, Technical Leadership
Lead Back-end Developer
2011 - 2013
MSI International
- Architected and implemented a custom CI/CD pipeline for firmware, resulting in a 50% faster deployment cycle.
- 为核心系统构建和设计新的体系结构，并对代码库进行广泛的重构, 使受影响范围内的新特性开发成本降低70%.
- Introduced Git for company-wide version tracking instead of SVN.
- Grew from a back-end engineer to a department lead in just two years.
- Led a team of talented developers, which included planning and executing projects, employee reviews, and career ladders.
- Fostered effective stakeholder communication within the department.
Technologies: Java, MySQL, Linux, Git, DevOps, Back-end Development, Architecture, Back-end, Automation, Technical Leadership
Experience
Special Iframe Proxy
我合作的一家公司，姑且叫它Xteam吧，它从各种门户网站销售服务.
Once a customer bought a specific service, Xteam went and created an account for the user within the portal, bought the service, and provided it back to the user with a margin, of course.
However, at some point, Xteam希望通过允许用户与门户交互而无需为某些服务提供凭据来增强客户端.
Lastly, some portals had just one login for all the customers. I invented and built a proxy with multiple functions to solve these issues.
Proxy Functions:
• It allowed the opening of nearly any page through an iframe by adjusting the headers.
•它可以执行隐藏的自动操作，比如登录而不向最终用户显示凭据.
• It rerouted all the links back to itself with mapping to the original links, so the proxy was aware of all the traffic from the site opened through an iframe. That way, it could restrict actions within portals and hide or change some parts of the portal, like filtering only cases related to a specific user for single account portals.
• It had logging interactions that could propagate changes back to the main system.
Once a customer bought a specific service, Xteam went and created an account for the user within the portal, bought the service, and provided it back to the user with a margin, of course.
However, at some point, Xteam希望通过允许用户与门户交互而无需为某些服务提供凭据来增强客户端.
Lastly, some portals had just one login for all the customers. I invented and built a proxy with multiple functions to solve these issues.
Proxy Functions:
• It allowed the opening of nearly any page through an iframe by adjusting the headers.
•它可以执行隐藏的自动操作，比如登录而不向最终用户显示凭据.
• It rerouted all the links back to itself with mapping to the original links, so the proxy was aware of all the traffic from the site opened through an iframe. That way, it could restrict actions within portals and hide or change some parts of the portal, like filtering only cases related to a specific user for single account portals.
• It had logging interactions that could propagate changes back to the main system.
PostgreSQL-based Multi-leg Flight Search
我设计并开发了一个基于PostgreSQL触发器的航班组合算法版本.
After a new flight is added or an existing one is updated, 数据库自动检查新组合的价格和有效性，并根据需要生成新的或删除无效的组合.
At the time, the database was processing 2,000 updates per second, 在3亿个现有组合之上，每秒有数以万计的更新.
对于搜索，我在多个搜索优化的PostgreSQL节点上使用级联复制.
After a new flight is added or an existing one is updated, 数据库自动检查新组合的价格和有效性，并根据需要生成新的或删除无效的组合.
At the time, the database was processing 2,000 updates per second, 在3亿个现有组合之上，每秒有数以万计的更新.
对于搜索，我在多个搜索优化的PostgreSQL节点上使用级联复制.
基于强化学习和卷积神经网络的自动交易系统
I developed a portfolio management system using CNN and RL. 系统每秒处理超过100万次更新，有状态的工作人员为聚合表示分组数据, which are then stored in ScyllaDB with over 10 billion rows and growing.
Tech: Python, Kafka, ScyllaDB, Celery, Redis, Kubernetes, Datadog
数据通过管道进行处理，以创建空间中重要特征的4D表示，为卷积神经网络和深度强化学习创建历史和实时数据集.
Tech: Python, Pandas, NumPy
I tried a lot of different architectures, with the best based on CSPDarknet53 ideas. First, 我通过并行独立代理实现了深度强化学习，训练同一个网络，使其能够同时处理整个投资组合，并在投资和对冲之间进行最佳分配.
A secure trader works with predictions and communicates with a broker API; it distributes capital between multiple algorithms and works with multiple trading accounts—monitoring, alerts, and an emergency kill switch with SMS.
Tech: EC2, IB API, AWS 2-way SMS, PagerDuty, Datadog, Python, Asyncio, Pandas, NumPy, Matplotlib, TensorBoard, TensorFlow, Keras, Jupyter
Tech: Python, Kafka, ScyllaDB, Celery, Redis, Kubernetes, Datadog
数据通过管道进行处理，以创建空间中重要特征的4D表示，为卷积神经网络和深度强化学习创建历史和实时数据集.
Tech: Python, Pandas, NumPy
I tried a lot of different architectures, with the best based on CSPDarknet53 ideas. First, 我通过并行独立代理实现了深度强化学习，训练同一个网络，使其能够同时处理整个投资组合，并在投资和对冲之间进行最佳分配.
A secure trader works with predictions and communicates with a broker API; it distributes capital between multiple algorithms and works with multiple trading accounts—monitoring, alerts, and an emergency kill switch with SMS.
Tech: EC2, IB API, AWS 2-way SMS, PagerDuty, Datadog, Python, Asyncio, Pandas, NumPy, Matplotlib, TensorBoard, TensorFlow, Keras, Jupyter
Reverse-engineering Websites and Fighting Anti-scraping
I've written about 200 functional scraping modules using various technologies.
Sometimes websites fight back with CAPTCHA programs, IP, and even recording mouse movements or exact click locations on elements.
在保持模块性能和尽可能节省流量的同时对抗这些保护，这有力地将我的创造力推向了一个完全不同的水平.
Technology Stack: Under NDA
Sometimes websites fight back with CAPTCHA programs, IP, and even recording mouse movements or exact click locations on elements.
在保持模块性能和尽可能节省流量的同时对抗这些保护，这有力地将我的创造力推向了一个完全不同的水平.
Technology Stack: Under NDA
Low Code Web Automation
我发明了一种软件，可以实现复杂的网络交互，而不需要任何编码，从而减轻工程团队的工作负担.
The system uses precoded elements, which extract data, interact with the page, and drag-n-dropped into the site automation plan. The system is designed to bypass CAPTCHA programs or other anti-scraping techniques.
Technology Stack: Under NDA
The system uses precoded elements, which extract data, interact with the page, and drag-n-dropped into the site automation plan. The system is designed to bypass CAPTCHA programs or other anti-scraping techniques.
Technology Stack: Under NDA
Education
2007 - 2011
High School Diploma in Computer Science
European Polytechnic Institute - The Czech Republic
Skills
Languages
Python, SQL, CSS, HTML, Bash, JavaScript, PHP, Java
Libraries/APIs
REST api, TensorFlow, SQLAlchemy, Beautiful Soup, Keras, Pandas, NumPy, Requests, Puppeteer, Node.js, SciPy, Asyncio, Interactive Brokers API, Matplotlib, Protobuf
Platforms
Linux, Docker, Amazon Web Services (AWS), Kubernetes, Apache Kafka, PagerDuty, Rancher, Amazon EC2, Google Cloud Platform (GCP)
Storage
PostgreSQL, Datadog, NoSQL, Redis, ScyllaDB, Elasticsearch, MySQL, Memcached, Database Replication, PostGIS, Redshift, MongoDB
Other
Software Architecture, AWS Cloud Architecture, Distributed Architecture, Web Scraping, Scraping, Back-end Development, APIs, Back-end, Architecture, API Integration, Technical Leadership, Technical Project Management, Apache Cassandra, WebSockets, Machine Learning, Convolutional Neural Networks (CNN), Proxy Servers, Relational Data Mapping, Data Structures, Localization, Software as a Service (SaaS), Deep Reinforcement Learning, Triggers, SSL Certificates, Regular Expressions, Proxies, Iframes
Frameworks
Flask, Django, Jinja, Scrapy, Chrome
Tools
GitLab CI/CD, GitLab, Git, NGINX, Celery, Jira, RabbitMQ, Ansible, Vault, Amazon Simple Notification Service (Amazon SNS), TensorBoard, Jupyter, Podio
Paradigms
DevOps, Agile, Automation, Data Science
Collaboration That Works
How to Work with Toptal
在数小时内，而不是数周或数月，我们的网络将为您直接匹配全球行业专家.
1
Share your needs
Discuss your requirements and refine your scope in a call with a Toptal domain expert.
2
Choose your talent
在24小时内获得专业匹配人才的简短列表，以进行审查，面试和选择.
3
Start your risk-free talent trial
Work with your chosen talent on a trial basis for up to two weeks. Pay only if you decide to hire them.
Top talent is in high demand.
Start hiring