Standards of Practice Guidance 17 January 2019
Artificial Intelligence and Its Potential Impact on the CFA Institute Code of Ethics and Standards of Professional Conduct
A Consultation
Artificial intelligence has the potential to impact the way an organization serves its clients’ needs and interests. We consider the impact these technological advances might have on ethics and professionalism.
Artificial Intelligence and Its Potential Impact on the CFA Institute Code of Ethics and Standards of Professional Conduct
Read the full report (PDF)Artificial intelligence (AI) and its subset, machine learning, are popular technologies in many industries today. The investment profession is no exception, and it is easy to understand why. The ability to process and store vast amounts of data beyond human capabilities in order to capture alpha is tempting. Investment management firms operate in a highly competitive environment, and many are looking at AI as a way to differentiate themselves.
One of AI’s many benefits is that it can identify patterns that are not apparent to humans. Cheap computing power and the availability of vast datasets make this possible. In some ways, AI can help reveal the “unknown unknowns,” which Donald Rumsfeld, former US Secretary of Defense, referenced in his now famous quote: “There are known knowns; there are things we know we know. We also know there are known unknowns; that is to say, we know there are some things we do not know. But there are also unknown unknowns; these are things we don’t know we don’t know.”
Through this paper, CFA Institute is seeking input on how the CFA Institute Code of Ethics and Standards of Professional Conduct (Code and Standards) might reflect the increased use of this new style of technology, as well as highlighting the need for caution in implementing it.
Background on AI and Implications for the Investment Industry
Investment theory and its application have evolved at a much slower pace than science and technology in other fields. Graham and Dodd’s seminal 1934 publication on value investing, Security Analysis, remains a strong influence on stock selection in both fundamental and quantitative investment strategies of firms today. In 1952, Nobel Prize winner Harry Markowitz published his groundbreaking work on Modern Portfolio Theory (MPT) in which he articulated investors’ “trade-off” between risk and return. Nearly two decades later, in the 1970s, Kenneth French and Eugene Fama introduced factor analysis and expanded the definition of common factor risk or beta. Combined, these theories serve as the foundation of quantitative investing.
In the late 1990s, the use of statistics to both measure investment outcomes and predict asset pricing behavior became more widespread as computing power further increased in the industry. As standard statistical approaches proliferated within investment management, differentiating methods and investment strategies from one firm to another became more difficult. This shift impeded the information advantage required for successful active management.
The term “artificial intelligence” was coined by Arthur Samuel in 1958. It broadly describes a computer’s use of algorithms to visualize data and improve the learning rate each time it “trains” or analyzes new data. AI is an umbrella concept that covers various methods to improve data analysis and predictions.
Machine learning is a subset of AI. It can be thought of as an algorithm that can learn from the dataset and improve the expected outcome through adaptive methods. The most simplistic example of this type of algorithm is linear regression. The most widely used definition of machine learning was developed by Tom Mitchell in 1997, when he stated the following:
“A computer program is said to learn from experience E with respect to some class of tasks T and performance measure P if its performance at tasks in T, as measured by P, improves with experience E.” 1
Tom M. Mitchell
This paper will work with the understanding that the technology processes of AI improve through the completion of programmed tasks and the availability of new data.2
Layers of Machine Learning Processes
The experience (E) component of machine learning may be classified as either supervised learning or unsupervised learning algorithms, or as variations of both types.
- Supervised learning. Humans pre-specify the data labels for inputs and pre-determine the problem output definition. The algorithm learns the mapping function from the inputs to the outputs. Supervised learning algorithms are solved through classification or regression. Examples include linear regression, random forests, and support vector machines.
- Unsupervised learning. Problem output is determined by the model, and humans do not supervise what the model should learn from the dataset. Unsupervised learning algorithms derive features from the patterns observed in the data. The output is learned from modelling the data’s underlying structure. Unsupervised learning problems may be grouped into clustering and association problems.
The next “layer” beyond machine learning under the AI umbrella involves methods that are tangent to or provide a framework for supervised or unsupervised learning.
- Reinforcement learning.This approach uses optimization to reward algorithms for high-value decisions. The interaction between algorithms and the data environment creates a feedback loop that that allows the algorithm to adapt to the new environment and proceed to the next set of actions until the desired goal is achieved.
- Deep learning. This method uses an artificial neural network to identify patterns in the data inputs. A neural network model determines the features from large datasets using supervised or unsupervised learning and creates a series of paths that identify and learn which patterns are important to determine outcomes. The neural network is designed to work like the human brain so that decisions are created in layers of neurons that serve to distill the data into features that become more recognizable as they move through each layer. The patterns identified become less complex using backpropagation techniques that eventually identify, by training on the dataset, the final output layer.
Implications for the Investment Management Industry
Technology’s ability to advance an information advantage will benefit firms that are cognizant of both the strengths and weaknesses of AI. The ability to mine vast quantities of data and incorporate it into asset valuation enhances the opportunity to create alpha. Computer science teams will be tasked to create models that consistently provide returns to clients. Successful model creation requires experience that will predominantly come from non-financial industries in which AI has made significant progress, such as medicine. For example, one medical radiology study using AI successfully identified 97 percent of lung cancers3. Experienced machine learning professionals understand the iteration process necessary to successfully train models to generalize.
Investment management firms must compete with other industries using this technology in order to hire experienced and capable professionals. Once the right technical experts are on board, investment teams and technical teams will need to be integrated in a way that creates checks and balances on the models and processes. Proper integration becomes essential because of the potential lack of transparency and interpretability in these models’ decision making.
There is an ongoing dialogue in all industries using AI that contemplates the impact of automation on human capital. The use of robotics in manufacturing and the general efficiencies being created through AI in banking, medicine, and retail are disrupting traditional means of employment. In investment management, it is inevitable that human interaction with data-related functions such as custody, fund administration, and other back-office operations will continue to become more efficient and potentially redundant.
The fee structures used by investment management firms when incorporating AI is another topic for discussions with clients. AI requires something of a leap faith by investors, because of opacity surround the operations of the technology. There is likely a lack of transparency in how the model isolated or named signals for specific investment decisions. However, the widespread adoption of AI in non-financial industries supports the theory that AI will transform investment management. Whether the lack of transparency will support fee-sharing models that reward the investor for assuming greater risk has yet to be clarified. The further integration of AI into mainstream investing processes will further challenge prevalent theories and statistical frameworks. Portfolios supported by modern portfolio theory (MPT) and factor/smart beta investing may become supplanted by more powerful AI-based pattern recognition alternatives.
The Need for an Appropriate Risk Management Framework
Providing a risk management framework for something unknown can be quite challenging. Although there is little doubt that AI has a future within investment management, it is vitally important to determine what risk management frameworks or changes are needed to incorporate it effectively. Unfortunately, there are no easy answers.
Machine learning models that incorporate deep learning require vast datasets. As the model trains, interpreting its decisions against the initial parameters may become increasing difficult. Advancing technology will also change the risks associated with making disclosures to clients as well as the supervisory obligations of the firms’ senior management teams. Regulation changes will also affect the expectations of firms incorporating AI and how firms internally track such regulatory obligations.
The incorporation of AI is often touted through the benefits to clients and the market while the potential new or increased risks are overlooked. Appropriate risk management frameworks will differ on many factors, including the scope of AI implementation and the services provided by the firm. Once a firm decides it will implement AI within the investment decision process, it may want to consider some of the following risk-related questions.
Data
Auditability/Interpretability
Disclosure
Senior Management Supervision
Regulation, Internal Policy, and Procedures
Firms should undertake an evaluation of the local regulatory framework at the onset of their use of AI and continuously during implementation. The firm’s compliance and legal teams should map this evaluation against current internal policies and procedures. Any gaps should be documented and proper updates approved, allowing firms to continue the safeguard of client assets in an ethical and professional manner.
Initial enthusiasm for AI in investment practice is not hard to find. This kind of excitement may tempt a poor manager with a poor strategy to replace its current practices with AI in the hopes of gaining new clients. Without a well-thought-out and well-defined AI strategy, however, the consequences of such a move may create a negative environment for all firms looking to implement emerging technological changes.
Market demands, competition, and increased cost pressure on investment management firms will no doubt increase AI use in the investment process. Under the guise of encouraging the investigation of AI while being cautious, firms should reflect on the adage “walk before you run.”
AI and the Code and Standards
So far we have looked at considerations for firms on the decision to engage AI. Although the practices their firms may use will vary, CFA Institute members and candidates must also consider the effects of AI implementation on their individual obligations under the Code and Standards. In the following section, we are seeking insights on AI practices. The SPC wants to understand if or how the Code and Standards should address such technological changes.
Several of the Standards of Professional Conduct (Standards) come to mind immediately for members who are considering the integration of AI. For discussion purposes, we group several relevant Standards into three areas of concern: Integrity, Engagement, and Accountability.
Integrity
The use of AI to make investment decisions may initially raise some questions about the application of the current Standards regarding Market Manipulation; Material Non-public Information; and Confidentiality. These Standards require individuals to act in a manner that protects the integrity of the broader capital market. By incorporating AI tools, individuals will potentially be less involved in the investment decision-making processes used to serve clients.
AI technology and practices are anticipated to learn and improve the longer they operate. Over time, AI could learn trading techniques or clarify biases ingrained in the initial coding that yield positive results for the firm and clients at the expense of a properly functioning capital market system.
Request for comment #1:
How might AI techniques be tested to detect potentially manipulative trading practices?
Request for comment #2:
How might AI techniques be tested for the potentially inappropriate incorporation of material non-public information into investment decision-making processes?
Request for comment #3
How might AI techniques be tested for the potentially inappropriate incorporation of confidential client information into investment decision-making processes?
Engagement
As the use of AI to make investment decisions increases, opacity around the decision-making process may increase. This reduced transparency may lead to questions on the current Standards regarding Communications with Clients; Suitability; and Diligence and Reasonable Basis. These Standards provide investors with reassurance that members are being thoughtful in managing their investments. As the member becomes less involved in the decision-making process, client assurances will still need to be maintained.
Providing clients with sufficient information about the investment process is critical to earning their trust. The Standards require effective disclosures of significant risks or limitations present in the investment strategy. Providing such disclosures may become challenging as advancing technology learns and modifies the initially developed algorithms.
Request for comment #4
How might clients be effectively informed of the use and therefore the risks and limitations of AI in the investment decision-making process?
Request for comment #5
How might AI techniques be tested to ensure alignment of client mandates within the investment decision-making process?
Request for comment #6
How might AI techniques be tested to ensure the investment decision-making process remains diligent to develop a reasonable basis for a recommendation?
Accountability
Previously in this paper, the notion of computers learning and improving on the investment decision-making process was introduced. Even with these advancements in technology, the firm and its employees are ultimately responsible to clients for the services provided. These responsibilities relate to the current Standards regarding Misrepresentation; Record Retention; and Supervisor Responsibilities. Clients will look to the firm to ensure that managers can address questions about the successful, as well as unsuccessful, decisions made using AI.
Clients rely on the information provided by the manager to make informed investment decisions. A manager must faithfully describe the processes it uses, including those involving AI. As the technological processes learn and evolve, clients must receive sufficient information to make an informed decision to remain in the strategy. This information will include understanding the current decision-making focus of the AI techniques.
Request for comment #7
How might AI techniques be tested and communicated with respect to how the current investment decision-making process aligns with the process previously described to clients?
Request for comment #8
How might a firm maintain records to support the AI investment decision-making process?
Request for comment #9
How might a firm educate those developing AI investment decision-making techniques around the fact that maintaining a commitment to protecting clients’ interests is paramount?
Other concerns will likely arise as you either begin or continue to include more advanced AI techniques within your firm. We present the ones identified in this paper as a means of starting the discussion to ensure such techniques continue to advance the industry while protecting the integrity of capital markets.
Alternatively, the concerns presented may lead firms to avoid incorporating AI practices. A movement into machine-based investing is not without risks. Firms need to be diligent in their decision-making process regarding how well this technology fits with the services they offer.
The SPC, through this paper, is seeking to provide a platform for discussing the benefits and concerns about the growing incorporation of AI within the investment management industry. We look forward to receiving your thoughts and feedback to the questions proposed, especially those questions related to specific elements of the Code and Standards. The insights of those applying or considering AI practices, as well as those who elected to pass on incorporating AI, will be useful as we strive to maintain the CFA Institute Code and Standards as the model of proper conduct for the investment management professional.
Footnote(s)
-
Tom M. Mitchell, Machine Learning (New York: McGraw-Hill Education, 1997).
-
Those who want to venture further into this subject can find several well-regarded textbooks on machine learning, including Deep Learning by Ian Goodfellow, Yoshua Bengio, and Aaron Courville; and Reinforcement Learning by Richard S. Sutton and Andrew G. Barto.
-
Nicolas Coudray, Paolo Santiago Ocampo, Theodore Sakellaropoulos, Navneet Narula, Matija Snuderl, David Fenyö, Andre L. Moreira, Narges Razavian, and Aristotelis Tsirigos, “Classification and Mutation Prediction from Non-Small Cell Lung Cancer Histopathology Images Using Deep Learning,” Nature Medicine 24 (17 September 2018): 1559–1567 (https://www.nature.com/articles/s41591-018-0177-5).
About the Author(s)
Julia K. Bonafede, CFA, is Co-Founder of Rosetta Analytics, an asset management firm that uses proprietary deep learning and deep reinforcement learning models to manage investment strategies. Previously, Ms. Bonafede served as President of Wilshire Consulting and was a member of Wilshire’s Board of Directors and Wilshire Consulting’s Investment Committee. She was listed as a top Knowledge Broker in Chief Investment Officer magazine’s annual list of the world’s most influential investment consultants in 2015. She is a member of CFA Institute and is a founding member of the United Kingdom Society of Investment Professionals. She currently serves on the CFA Institute Standards of Practice Council and the Advisory Board of the Financial Data Professional Institute of CAIA Association.
Corey Cook, CFA, has more than two decades of experience in financial services, technology, and consulting as a senior executive and board director. Currently, he is an independent consultant, a Trustee of Goodenough College, and an Advisor with the UK Pensions Ombudsman where he assists members of the public with pension disputes.
Mr. Cook was formally the Chief Administrative Officer in Europe for RBC Global Asset Management, where he led the implementation of MiFID II. He is both a Chartered Financial Analyst and a member of the Chartered Institute of Information Security. Mr. Cook holds a MSc in Management from the London School of Economics and a BA in Economics from McGill University in Montreal, Canada.
Mr. Doggett is a director of professional standards for CFA Institute. His responsibilities include providing member guidance in applying the ethics and standards of practice policies, supporting related educational and public awareness activities, and working with the Standards of Practice Council of CFA Institute on its initiatives. Previously, Mr. Doggett, as a member of the CFA Institute Financial Reporting Policy Group, represented membership interests regarding reporting and disclosures initiatives, including XBRL.
Prior to joining CFA Institute, Mr. Doggett worked in the financial information sector with SNL Financial. There his work focused on the real estate and energy industries, directing the development and maintenance of a financial data storage system. Mr. Doggett regularly provided insights to the media on events and performance of the Real Estate Investment Trust industry.
Mr. Doggett holds a BA in economics from the University of Virginia. He was awarded the CFA designation in 2006 and is a member of CFA Virginia.