[et_pb_section bb_built="1"][et_pb_row _builder_version="3.6" module_class_1="ds-vertical-align" module_class_2="ds-vertical-align" make_equal="on"][et_pb_column type="2_3"][et_pb_text admin_label="Challenge" _builder_version="3.6"]


One of our existing clients had been using their own machine learning strategies to develop an in-house platform in order to produce trading signals from a range of alternative datasets. The 4-person development team had been running for six months, working on building a suite of Python applications and Big Data processing pipelines, both on premise and in Amazon AWS cloud. The client approached Hentsū to extend their own small development team, and to improve the overall software development. The pace of functionality releases was slow, the applications were suffering from complexity and the code quality was poor. The in-house developers were experiencing significant struggles to work as a unified team. Code was being committed and deployed with broken library dependencies, resulting in manual fixes every release to ensure code was running correctly. The applications were disjointed and inconsistent, with very loosely coupled sets of scripts, software, and services. There was no robust deployment of the applications, and once deployed there was often the need to intervene manually.

Key Requests

  1. Deliver more functionality, faster
  2. Reduce code bugs and improve stability of the application
  3. Deploy the application faster to any environment
[/et_pb_text][/et_pb_column][et_pb_column type="1_3"][et_pb_blurb _builder_version="3.6" title="Initial Components" background_color="#e3e3e3" custom_padding="10px|10px|10px|10px"]
  • 4-person in-house development team
  • Alternative data sets
  • In-house VMware and AWS cloud
  • Proprietary Python and TensorFlow code
  • MongoDB for data and results
[/et_pb_blurb][/et_pb_column][/et_pb_row][et_pb_row _builder_version="3.6" make_equal="on" module_class_1="ds-vertical-align" module_class_2="ds-vertical-align"][et_pb_column type="1_3"][et_pb_blurb _builder_version="3.6" title="Technologies Used" background_color="#e3e3e3" custom_padding="10px|10px|10px|10px"]
  • Atlassian JIRA – roadmap, sprints and issue tracking
  • Atlassian Confluence – documentation
  • Atlassian BitBucket – source code
  • Atlassian Pipelines – build, testing and deployment
  • Amazon AWS – Elastic Container Registry (ECR) and environments
[/et_pb_blurb][et_pb_image admin_label="DevOps Workflow" _builder_version="3.6" src="https://hentsuprod.wpengine.com/wp-content/uploads/2018/06/DevOps-Workflow.jpg" show_in_lightbox="on" /][/et_pb_column][et_pb_column type="2_3"][et_pb_text admin_label="Solution 1" _builder_version="3.6"]


DevOps Workflow

Hentsū promptly identified the need to deploy the most efficient Continuous Integration/Continuous Deployment (CI/CD) pipeline, as fast as possible. The focus had to be on feature development rather than tooling, as well as on the removal of any difficulties in getting great code from the developers - quickly. As a first phase, Hentsū deployed a development workflow, which was based around the Atlassian suite of products. The goal was to enable rapid iteration of the team’s code, whilst ensuring overall software testing, quality control and integration. The workflow relied on properly defined environments – Development, Testing, Acceptance, Production (DTAP). Deploying these steps and enforcing the code flow produced an instant improvement in both the collaboration across the team, and the quality of software. There was much improved visibility on what any one developer was pushing into the branches and its effect on the overall software. Separately, Hentsū worked with the developers to restructure the Git software repositories logically into specific areas of concern (apps/services/dependencies). Each repository would contain its own tests, dependency tree and Bitbucket pipeline YAML config. This enabled more autonomy in development, whilst retaining efficient control over the cross-platform dependencies and testing. Finally, the agile methodology was improved through the use of clearer structure and scheduling. To ensure better code quality and higher feature throughout there was a particular focus on activities such as sprint start, standups, development time, smoke tests, and backlog refinement. Product ownership and feedback was improved within the business by clearly identifying each feature owner and involving them in the sprint process. [/et_pb_text][/et_pb_column][/et_pb_row][et_pb_row _builder_version="3.6" make_equal="on" module_class_1="ds-vertical-align" module_class_2="ds-vertical-align"][et_pb_column type="2_3"][et_pb_text admin_label="Solution 2" _builder_version="3.6"]

Docker Architecture

Hentsū deployed a 3-person team to augment the in-house developers. The team brought Python and containerisation expertise to re-architect the applications and make them more stable, self-contained, and easily distributed across environments. Whilst the Git repositories were restructured, the corresponding Docker images were rolled out for each specific service. Docker registry and Elasticsearch services from AWS were used to help with the deployments and monitoring, without having to stand up infrastructure. To help with the deployment, scaling and management of the Docker containers, a Hentsū customised Kubernetes platform was rolled out. The customisation also allowed the client to overcome the limitations in the AWS EKS service and integrate VMware environments. This ensured consistency of deployment and tooling, but also allowed for the applications to be deployed to Azure and Google Cloud Platform (GCP).

Kubernetes Cluster

Using a Kubernetes cluster, Hentsū enabled the additional functionality of automatic scaling. Worker nodes were able to run as a static number, which could be useful on-premise to limit the impact on other resources. However, as the Python code had the capability to work in parallel, deploying autoscaling allowed the number of nodes to ramp up quickly based on the queue of work. If there was a bigger queue of incoming data to process, the entire cluster could autoscale to thousands of nodes if needed. Each individual worker node was a small enough unit of compute/memory that the autoscaling for different loads of work became very linear and cost efficient. Combining the Hentsū Kubernetes cluster management and AWS meant that the client had many more options to manage the workloads. The cluster could rapidly adapt between specific GPU enabled worker instances, whilst simultaneously the client was able to use the AWS Spot market for cheaper resources when available and move the application between regions or even cloud providers. Another new possibility this opened up was deploying to bare metal, allowing for VMware to be discarded.

[/et_pb_text][/et_pb_column][et_pb_column type="1_3"][et_pb_blurb _builder_version="3.8" title="Technologies Used" background_color="#e3e3e3" custom_padding="10px|10px|10px|10px"]
  • Docker – containerisation
  • Angular – front end interfaces
  • Kubernetes – cluster management
  • Helm – package management
  • Kubespray and Ansible – Kubernetes deployment
  • AWS Elasticsearch, Prometheus and Grafana – application and system monitoring
[/et_pb_blurb][et_pb_image admin_label="Kubernetes Cluster" _builder_version="3.6" src="https://hentsuprod.wpengine.com/wp-content/uploads/2018/06/Kubernetes-Cluster.png" show_in_lightbox="on" /][et_pb_image admin_label="Security Kubernetes" _builder_version="3.6" src="https://hentsuprod.wpengine.com/wp-content/uploads/2018/06/Security-Kubernetes-Cluster.png" show_in_lightbox="on" /][/et_pb_column][/et_pb_row][et_pb_row][et_pb_column type="4_4"][et_pb_text admin_label="Solutions 3" _builder_version="3.6"]

Security Considerations

With the ability to run the Python code in various cloud platforms, and potentially also utilise Platform as a Service (PaaS) from the cloud providers, the security of the intellectual property was of concern. Hentsū deployed the entire solution with strict adherence to its own developed ISO 27001 cloud security checklist. Encryption was built into the application from the start, and all user access controls were tied back to the client’s corporate Active Directory. [/et_pb_text][et_pb_text admin_label="Impact" _builder_version="3.6"]


The improvements and options Hentsū enabled meant developers were happier and substantially more productive with their coding. Additionally, the team collaboration and the engagement of the business stakeholders meant that more features than initially planned were released to the end users, and in a faster timeframe. The number of bugs which were raised in production from each two-week release cycle was reduced from an average of over 30, to below 2. This code quality success was ensured by the improvements Hentsū implemented to the scheduling and structure, such as the Pipeline unit tests, the consistency of the development and acceptance environments, and the rigorous smoke tests. The greatest impact was the overall delivery of the project. When Hentsū was first engaged the estimate for remaining time to deliver the project was 18-24 months; however with the changes delivered by Hentsū the project was completed in under 6 months. [/et_pb_text][et_pb_cta _builder_version="3.6" title="Talk to us about your cloud workloads" button_text="Contact Us Today" button_url="https://hentsuprod.wpengine.com/contact" url_new_window="on"] See how Hentsū can enable your data science workloads across multiple clouds, using DevOps techniques and Docker containerisation. [/et_pb_cta][/et_pb_column][/et_pb_row][/et_pb_section]


Date(s) - 01/01/1970
12:00 AM - 12:00 AM


600 5th ave. NY, NY
[et_pb_section bb_built="1"][et_pb_row][et_pb_column type="4_4"][et_pb_text _builder_version="3.6"]

Hentsū Growth

Hentsū is a public cloud managed service provider for hedge funds. Founded in London in 2015, Hentsū first opened doors in the US almost two years ago. Since then our New York City office has been expanding thanks to the rapid embrace of the public cloud across hedge funds. Public cloud adoption in the financial services and especially in the hedge fund and asset management space continues to grow. To satisfy this demand we are always looking for ways to grow and expand our service. We are now excited to be launching our Boston office!

Hentsū Boston

The Hentsū Boston presence allows us to better assist the region’s firms to unlock the full value of the public cloud. A local presence means we can partner more efficiently with clients throughout every phase of their transition to the public cloud. We handle everything from migrations of on-premise or private cloud infrastructure to designing the architecture for your trading and research environments. [/et_pb_text][et_pb_testimonial _builder_version="3.6" author="Marko Djukic" quote_icon_background_color="#f5f5f5" job_title="CEO"] We recognize the need for public cloud services for hedge funds in the Boston region where traditional legacy providers currently prevail. The market is demanding a shift for these funds to remain competitive and relevant, and we’re excited to be at the forefront leading the way. [/et_pb_testimonial][et_pb_text admin_label="Text 2" _builder_version="3.6"]

More Value with Public Cloud

An increasing number of asset management firms and hedge funds are rapidly embracing the value the public cloud has to offer. Hentsū can maximise the value of the public cloud to deliver a service for its clients which is unrivaled by any on-premise or private cloud. We have been working with many asset managers, large and small, and across all asset classes. There are several consistent themes behind their move to the public cloud. Not only are firms able to access more features and functionality around collaboration, their applications and their data, but they do so with better security, resiliency and control of their systems. In most cases, firms can also achieve cost efficiencies over the on-premise or legacy private clouds. More importantly, unlike private cloud solutions, Hentsū and the public cloud allow firms to be the only owners of their systems and their data. The end clients are always the account owners and have access to administrative rights.

About Hentsū

We have the breadth and depth of knowledge and experience to design, build and manage every aspect of your hedge fund technology. We offer next generation Corporate IT with cloud-based offerings such as O365 and OneDrive, Cloud Strategy Roadmap Design and Implementation, Data Science as a Service and Regulatory Technology solutions. Talk to us about your public cloud strategy today. Contact us at hello@hentsu.com [/et_pb_text][et_pb_cta _builder_version="3.6" title="Talk to us about your public cloud strategy today" button_text="Contact Us Today" button_url="https://hentsuprod.wpengine.com/contact" url_new_window="on"] Are you in Boston and need to improve how you run your hedge fund technology? Concerned with your legacy private cloud provider? Not getting the service you need? Hentsū can help! [/et_pb_cta][/et_pb_column][/et_pb_row][/et_pb_section]


Date(s) - 01/01/1970
12:00 AM - 12:00 AM


600 5th ave. NY, NY
Having been proud supporters of ALTSO and having attended the uber-fun Rocktoberfest in NYC, the Hentsū London team was very excited with the news that Rocktoberfest-London would be coming in June. And what an event it was! Drinks were flowing and the music was great thanks to the amazing line up (bands consisting of hedge fund and asset managers) - they were totally rocking it just like they promised! The food was fantastic and the fun photo booth laughs and great company to enjoy it with really made for a wonderful night. Thank you to team ALTSO for such a fun night and for letting us be part of something so wonderful like helping your #coolkids. For more information about ALTSO or to contribute to the cause check out their website: https://www.altso.org/  


Date(s) - 01/01/1970
12:00 AM - 12:00 AM


600 5th ave. NY, NY