Machine Learning Overview

Machine learning is emerging. The technique backing technologies such as Google’s game playing AlphaGO, self-driving cars, and cancer diagnosis assistants, is now one of the more promising trends in the financial industry.

Many of us have come to know it in different ways; artificial intelligence (AI), machine learning (ML), or deep learning (DL). We will start by clarifying these concepts.

ai; artificial intelligence; trading

Artificial intelligence is intelligence exhibited by machines. It is the general topic that encompasses a vast range of subfields. Machine learning is one of the most successful approaches to realising AI. In fact, some researchers believe that it is the key to True AI. Furthermore, deep learning originated from neural networks, a classic machine learning algorithm modeled on the human brain and nervous system, and is now a powerful toolbox in machine learning. Most recent successes of machine learning in application areas are likely to be driven by deep learning, such as image and speech recognition.

Practical Application  

Machine learning managed to outperform humans on many well-defined problems. For example, the ability to recognise an object in a photo and identify a person from his or her face. Those problems were heavily studied for decades, and some mature non-machine learning techniques worked well. However, solutions based on machine learning really push the performance to the line that traditional methods cannot reach. These discoveries have happened only in the last 5 years. Machines beating humans is no longer simply a headline for news, this kind of system is usable in real life practical application.

Apart from these end-to-end applications, machine learning now plays an important role in some more complicated systems such as Siri or Google Now. Machine learning also provides the fuel to related areas such as data mining. For example, when you are looking for something in Google or Amazon, you may have personally customised results that differ from others. Machine learning is not only for the high-tech internet companies, but also for many established industries, such as drug designs in medicine, automatic summarising of documents in legal, and robo-advisors in trading.

The Rising Trend of Deep Learning

Deep learning significantly reduces the challenges around building an in-house solution because the framework is very standardised and the software for such a framework is available for free.

As an example, many experienced PhDs have spent years building a facial recognition system that could achieve 80% accuracy and have published thousands of research papers. Now, a bachelor with basic programming skills can build a 90% accuracy system in a day by reading a blog post. By learning some slightly more advanced techniques, the system can be further improved to roughly 99% accuracy, which was nearly impossible ten years ago, even for the most successful researchers and industry practitioners in the field.

Readers can try this too through Microsoft Cognitive Services Face API

Interestingly, the top-tier players in the industry still have clear advantages, because the improvement from 99% to 99.1% becomes extremely hard for the beginners in deep learning. The entry-level is now 99.95% for a facial recognition start-up.

Machine Learning in Finance


FICO score is the well-known measurement of customer’s credit risk in the lending industry. The early version of the FICO score implementation was based on logistic regression. Surprisingly, logistic regression is still popular in the era of deep learning, but we have much improved variants of it. The decision engine of many lending companies, especially those internet-based lenders, is built upon machine learning algorithms. This kind of fully automatic system is proven to be more reliable compared to human decision.


Robo-advisors, such as Betterment, Schwab and Vanguard, provide portfolio management based on algorithms. Although the algorithms were largely rule based in the early stages, machine learning appears to be the future direction. The rule-based approach heavily depends on human expertise, but some machine learning algorithms can generate rules without human effort. However, this does not suggest that a machine learning solution is designed to exclude human bits. In fact, there is a topic in machine learning investigating how to combine human expertise and machine learning algorithms with constraints.

For more information, join our April 20th Cognitive Cloud workshop in London, which will be focused on AI and machine learning in trading.