During this same time we were going through a long series of meetings with the LTC IT department. The motto of the LTC-IT was “we will give you anything you want, just tell us what columns you need in your flat file”. For instance, the LTC-IT project documentation had extensive sections for listing data elements extracted and the databases they were extracted from – but only a minimal project memo section to describe what to do with those data elements. A project that didn't involve extracting data into a file was almost impossible to describe using the IT project documentation.
The LTC-IT department and my group had a very contentious relationship from the start. For instance, the LTC-IT was maintaining a marketing data warehouse, but they refused to allow marketing employees to access the data warehouse. We had to fill out data requests that a small group of data pullers would fulfill. Quite quickly my group found a back door into our own data warehouse simply to do our jobs.
The organizational interface between LTC-IT and the rest of the company was a Project Management Office – the PMO. PMOs were in theory supposed to have neither an understanding of the business nor an understanding of technical details but were supposed to facilitate communication between the business and technical side. In practice, because the PMOs wrote the project documents before technical IT got involved they ended up making critical technical design decisions and setting business objectives.
The LTV project was going to be unique for LTC. Employees in the marketing department were going to be developing formulas and code for the IT department to implement instead of giving the IT department high-level business concepts for design and implementation. The project manager (PM) and I spent a number of months working out the details of the interaction between our departments. When the project got to upper PMO management it was soundly rejected. According to the PMO office the LTC-IT did not have the technical competence to support model implementation and that the Marketing Department would have to supply the technical expertise to implement the LTV models.
I was overjoyed at this news. It meant minimal contact with the LTC-IT and PMO and that I could have direct oversight over the most critical matters.
The next issue we had to resolve with the LTC-IT department was where to run the LTV system. If we were going to be putting scores into the data warehouse, the LTV-IT insisted that the code be run on a server (not a problem). They also pointed out that instead of getting our own server it made a lot more sense to share a server with another department (again, not a problem). The LTV-IT found a server for us – with 275MB available disk space. Now we have a problem. Considering the potential impact of the LTV project 275MB was fairly ridiculous. Fortunately, we were able to design a trimmed-down process that fit in 275MB.
This was where wearing multiple hats on the project became very handy. A design group that was separate from implementation would have made sure that the design was complete enough and robust enough to cover all contingencies, and it would have been a lot larger that 275MB. Because design and implementation were the same we knew exactly where to cut corners.
Showing posts with label LTV. Show all posts
Showing posts with label LTV. Show all posts
Sunday, April 13, 2008
Friday, April 11, 2008
LTV at LTC: Difficult Allies
A particularly long and difficult set of meetings that we had was with the LTC Finance Group (FG).
These meetings were, of course, difficult. LTV projects by their nature are focused on customers and their value and that makes LTV projects in the Marketing Department's area; but LTV also involves financial impact and financial data and that makes it part of the Finance Department's area. I suspect that if there is an LTV project where Marketing and Finance are not arguing about the details then the project isn't being taken seriously by either department.
The FG was currently managing an LTV-like project and had been for a number of years. What FG did was to look at revenue and cost data and then give profitability data by rate plan. Profitability by rate plan really wasn't that useful to LTC. It gave no understanding of the 'why' behind customer value or how to treat individual customers.
We needed the FG for was to understand the cost metrics associated with customer activity. In particular, our executive sponsor insisted that we have FG's approval for out LTV project. We went to the FG with the question “What is the right formula to calculate customer related costs?” -- and they refused.
Well, they didn't refuse, exactly. What happened after that was a long series of meetings with various financial people, getting one small piece of data from each. Then came time to put all the pieces together and life started getting difficult.
The FG refused to either accept or reject our meeting requests, meaning we could never be sure if a meeting was actually on or not until we made the call. They would also invite themselves to other meetings, so we had to be ready to talk about LTV issues at any time. Our questions got answered obliquely. For instance, when we asked about the best way to handle network minutes the reply was “What would happen if all of our customers leave?”
As it developed, the FG and our group did develop a substantial difference of opinion in how to value customers. It revolved around how to handle capital expenses. The FG was adamant that any customer valuation include capital expense; I felt strongly that the customer LTV should not. I had two reasons. First, no future customer activity could effect capital projects that had already been purchased. LTV should be about customer impacts to LTC, not things that individual customers had little impact on. Second, including capital expenses would mean that 25% of the customers would have negative value; without capital expenses 7% of the customers would be have negative value.
Let me digress here on negative LTV. By and large, in any company there will be some customers that cost more in company resources than they bring in in revenue. One of the best goals of any LTV project is correctly identifying customers of negative value so they can be understood, targeted, addressed, and if necessary 'fired'. It is absolutely natural to take customers with negative LTV and take them out of customer retention programs.
Cutting 7% of the base out of marketing programs at LTC designed to increase retention would have minimal impact on the overall attrition results. Taking 25% of the customer base out of retention marketing programs would have a definite impact on the corporate retention efforts.
LTC lived and died by retention and attrition. If LTV hurt retention then LTV would be quickly and quietly abandoned.
We spent months in rounds of inconclusive meetings with FG, asking again and again about the correct formulation. Suddenly, they agreed with us and we could go forwards. As we found out later, their agreement was by accident. The FG simply misread the formula we were laying out and thought it included capital expenses. By the time the FG realized they had made a mistake the LTV system was already in production and going forwards.
There is a bit of an irony here. If the FG had simply worked with us and given us their cost formula we would have taken it uncritically and not done the research to discover the issues around capital expenses.
Despite our differences the two groups did come to an understanding and became allies on many issues. Both groups wanted to move LTC from gross revenue to sustainable profit. We both realized that two areas that LTC had ignored, off-net expenses1 and bad debt expenses, were critical to profitability.
These meetings were, of course, difficult. LTV projects by their nature are focused on customers and their value and that makes LTV projects in the Marketing Department's area; but LTV also involves financial impact and financial data and that makes it part of the Finance Department's area. I suspect that if there is an LTV project where Marketing and Finance are not arguing about the details then the project isn't being taken seriously by either department.
The FG was currently managing an LTV-like project and had been for a number of years. What FG did was to look at revenue and cost data and then give profitability data by rate plan. Profitability by rate plan really wasn't that useful to LTC. It gave no understanding of the 'why' behind customer value or how to treat individual customers.
We needed the FG for was to understand the cost metrics associated with customer activity. In particular, our executive sponsor insisted that we have FG's approval for out LTV project. We went to the FG with the question “What is the right formula to calculate customer related costs?” -- and they refused.
Well, they didn't refuse, exactly. What happened after that was a long series of meetings with various financial people, getting one small piece of data from each. Then came time to put all the pieces together and life started getting difficult.
The FG refused to either accept or reject our meeting requests, meaning we could never be sure if a meeting was actually on or not until we made the call. They would also invite themselves to other meetings, so we had to be ready to talk about LTV issues at any time. Our questions got answered obliquely. For instance, when we asked about the best way to handle network minutes the reply was “What would happen if all of our customers leave?”
As it developed, the FG and our group did develop a substantial difference of opinion in how to value customers. It revolved around how to handle capital expenses. The FG was adamant that any customer valuation include capital expense; I felt strongly that the customer LTV should not. I had two reasons. First, no future customer activity could effect capital projects that had already been purchased. LTV should be about customer impacts to LTC, not things that individual customers had little impact on. Second, including capital expenses would mean that 25% of the customers would have negative value; without capital expenses 7% of the customers would be have negative value.
Let me digress here on negative LTV. By and large, in any company there will be some customers that cost more in company resources than they bring in in revenue. One of the best goals of any LTV project is correctly identifying customers of negative value so they can be understood, targeted, addressed, and if necessary 'fired'. It is absolutely natural to take customers with negative LTV and take them out of customer retention programs.
Cutting 7% of the base out of marketing programs at LTC designed to increase retention would have minimal impact on the overall attrition results. Taking 25% of the customer base out of retention marketing programs would have a definite impact on the corporate retention efforts.
LTC lived and died by retention and attrition. If LTV hurt retention then LTV would be quickly and quietly abandoned.
We spent months in rounds of inconclusive meetings with FG, asking again and again about the correct formulation. Suddenly, they agreed with us and we could go forwards. As we found out later, their agreement was by accident. The FG simply misread the formula we were laying out and thought it included capital expenses. By the time the FG realized they had made a mistake the LTV system was already in production and going forwards.
There is a bit of an irony here. If the FG had simply worked with us and given us their cost formula we would have taken it uncritically and not done the research to discover the issues around capital expenses.
Despite our differences the two groups did come to an understanding and became allies on many issues. Both groups wanted to move LTC from gross revenue to sustainable profit. We both realized that two areas that LTC had ignored, off-net expenses1 and bad debt expenses, were critical to profitability.
Wednesday, April 9, 2008
LTV at LTC: The New Economy Consulting Company (NECC)
One lengthly set of meetings that did work out very well as with the New Economy Consulting Company (NECC), a company that started out specializing in Internet marketing but by 2002 had branched out into general customer relationship management consulting.
NECC was leading their own LTV project which ultimately got nowhere but our project was able to use many of their insights.
NECC had realized that LTV comes in four flavors:
Usually, when we think of LTV we think of just (1). At LTC all four metrics were very useful.
LTC had a very large customer acquisition cost; it often took a year for a customer to pay of their acquisition cost. By tracking a customer's past and future values separately we were able to see the full impact of different acquisition strategies.
LTC's direct marketing concentrated on retention efforts, and the difference between Expected Future Value and Potential Future Value became the natural metric to run attrition campaigns against (i.e., if a customer's EFV was $250, and PFV was $475, then $475 - $250 = $225; if we plan on recovering 10% of the difference between EFV and PFV then for that customer we shouldn't spend more that $22.50 to do so).
The NECC project never got beyond PowerPoint because they had made no plans for implementation. Once the report was complete the project faded away.
Moreover, NECC never really dove into the financials of LTC. What they did was to go around asking people what they thought was important and put together the subjective, narrow opinions. A project like LTV is a rare chance to look at a problem holistically and completely and the chance to bring new understanding to the enterprise as a whole should not be missed.
NECC was leading their own LTV project which ultimately got nowhere but our project was able to use many of their insights.
NECC had realized that LTV comes in four flavors:
- Expected Future Value
- Total Past Value
- Potential Future Value: What would the customer be worth is there was no churn?
- Expected Life Value: (1) + (2)
Usually, when we think of LTV we think of just (1). At LTC all four metrics were very useful.
LTC had a very large customer acquisition cost; it often took a year for a customer to pay of their acquisition cost. By tracking a customer's past and future values separately we were able to see the full impact of different acquisition strategies.
LTC's direct marketing concentrated on retention efforts, and the difference between Expected Future Value and Potential Future Value became the natural metric to run attrition campaigns against (i.e., if a customer's EFV was $250, and PFV was $475, then $475 - $250 = $225; if we plan on recovering 10% of the difference between EFV and PFV then for that customer we shouldn't spend more that $22.50 to do so).
The NECC project never got beyond PowerPoint because they had made no plans for implementation. Once the report was complete the project faded away.
Moreover, NECC never really dove into the financials of LTC. What they did was to go around asking people what they thought was important and put together the subjective, narrow opinions. A project like LTV is a rare chance to look at a problem holistically and completely and the chance to bring new understanding to the enterprise as a whole should not be missed.
Tuesday, April 8, 2008
LTV at LTC: First, Meetings
Of course once we got approval we didn't start building the system. We started having meetings about building the system.
The first set of planned meetings didn't actually happen, which was a very good thing. Our manager wanted us hold bi-weekly meetings with managers from across the marketing organization. These meetings would have been a disaster.
We didn't know enough about LTV in general and customer behavior at LTC in specific to be able to lead these meetings. We would have had a group of senior managers taking about a project that got at the heart of how LTC did business with no real agenda for these meetings. As I found out in the course of the project, LTC was an information-starved company and very few people had a good idea of the real internal financials of the company. The most likely result of these planned meetings would have been tangential suggestions and demands that would have misdirected the project.
One of the lessons we learned from this project was how important it is to manage the meetings around a project: early meetings should be held with those necessary to get the project done but large meetings with the simply interested should be avoided until the leaders can bring a lot of understanding and direction to the meetings.
The first set of planned meetings didn't actually happen, which was a very good thing. Our manager wanted us hold bi-weekly meetings with managers from across the marketing organization. These meetings would have been a disaster.
We didn't know enough about LTV in general and customer behavior at LTC in specific to be able to lead these meetings. We would have had a group of senior managers taking about a project that got at the heart of how LTC did business with no real agenda for these meetings. As I found out in the course of the project, LTC was an information-starved company and very few people had a good idea of the real internal financials of the company. The most likely result of these planned meetings would have been tangential suggestions and demands that would have misdirected the project.
One of the lessons we learned from this project was how important it is to manage the meetings around a project: early meetings should be held with those necessary to get the project done but large meetings with the simply interested should be avoided until the leaders can bring a lot of understanding and direction to the meetings.
Saturday, April 5, 2008
LTV at LTC: Project Approval
The first step of the LTV project was to get IT approval and budgeting. In order to get the project used we needed to get the results loaded into the company data warehouse; in order to get that load we needed IT support. At the time we were also planning on having the LTV production system managed by the IT department; fortunately we wound up running the production system ourselves.
LTC had just instituted a strict resource allocation process for IT projects. Each project had to be justified in terms of return on investment based on financial analysis and passed by a committee of representatives of the various branches of the business. On the face of things this is a very straightforwards process but LTV was almost wrecked here.
The first issue was that customer value was a substantial change from the way LTC thought about customers. LTC had been committed to maintaining all their customers and fighting attrition (customers leaving the company) across the board. The idea that some customers were more valuable than others, and in fact some customers cost LTC more than their were worth, was a foreign concept. Because LTV represented a new way of thinking about the business the LTV project could not be valued in the attrition-based results metrics that were approved for use.
The second issue is that the IT project approving committee was composed of representatives from a broad spectrum of departments in LTC. In theory this was to ensure that the projects that were approved would be useful to the entire company. In practice, projects were decided on by committee members that had no IT experience, no experience in the processes of other departments, and not enough time to truly research the issues they were being asked to decide on. What happened was that projects got decided by corporate politics: the person reputation of the executive champion.
It was in getting our initial approval that our executive champion (EC) shone. Our EC had a considerable reputation within the company. It terms of making the ROI cutoff, what we did was to figure out the attrition gain necessary to make the cutoff and the EC promised to delivery that gain. We knew that the LTV system wasn't targeted at reducing attrition per se, but we also knew that if the project was at all successful getting approval after the fact would not be an issue.
The long approval process did have a substantial benefit: the series of meetings made most of the company aware of the LTV project.
LTC had just instituted a strict resource allocation process for IT projects. Each project had to be justified in terms of return on investment based on financial analysis and passed by a committee of representatives of the various branches of the business. On the face of things this is a very straightforwards process but LTV was almost wrecked here.
The first issue was that customer value was a substantial change from the way LTC thought about customers. LTC had been committed to maintaining all their customers and fighting attrition (customers leaving the company) across the board. The idea that some customers were more valuable than others, and in fact some customers cost LTC more than their were worth, was a foreign concept. Because LTV represented a new way of thinking about the business the LTV project could not be valued in the attrition-based results metrics that were approved for use.
The second issue is that the IT project approving committee was composed of representatives from a broad spectrum of departments in LTC. In theory this was to ensure that the projects that were approved would be useful to the entire company. In practice, projects were decided on by committee members that had no IT experience, no experience in the processes of other departments, and not enough time to truly research the issues they were being asked to decide on. What happened was that projects got decided by corporate politics: the person reputation of the executive champion.
It was in getting our initial approval that our executive champion (EC) shone. Our EC had a considerable reputation within the company. It terms of making the ROI cutoff, what we did was to figure out the attrition gain necessary to make the cutoff and the EC promised to delivery that gain. We knew that the LTV system wasn't targeted at reducing attrition per se, but we also knew that if the project was at all successful getting approval after the fact would not be an issue.
The long approval process did have a substantial benefit: the series of meetings made most of the company aware of the LTV project.
Friday, April 4, 2008
LTV at LTC: A Unusual Start
My involvement in the project started in January 2002. I was managing a modeling / statistical analysis group in the marketing department of LTC. We had a consultant do an initial proof-of-concept and it became my job to fully flesh out the approach and put LTV into production.
Already, the project was off to an unusual start. I was simultaneously
Usually, these are four different people. I believe the project's success was do in no small part to all four roles being being condensed into one person. Whenever issues came up I could simply make a decision instead of having to a) document the issue b) have meetings on the issue c) discuss possible solutions d) document the final solution e) get written agreement on the change from all parties f) finally implement the solution.
For larger projects it may not be possible to be as concentrated as this, but I do think there needs to be one vision behind the project, someone who understands both the technical aspects and the business aspects of the project. Without one person that has a deep understanding of the different aspects of the project and can share that understanding with the rest of the team, none of the parts of the project will fit together.
Already, the project was off to an unusual start. I was simultaneously
- The primary business owner/ representative.
- The project manager.
- The chief analytic designer.
- The head of implementation.
Usually, these are four different people. I believe the project's success was do in no small part to all four roles being being condensed into one person. Whenever issues came up I could simply make a decision instead of having to a) document the issue b) have meetings on the issue c) discuss possible solutions d) document the final solution e) get written agreement on the change from all parties f) finally implement the solution.
For larger projects it may not be possible to be as concentrated as this, but I do think there needs to be one vision behind the project, someone who understands both the technical aspects and the business aspects of the project. Without one person that has a deep understanding of the different aspects of the project and can share that understanding with the rest of the team, none of the parts of the project will fit together.
Labels:
business intelligence,
LTV,
projects,
statistics
Sunday, March 30, 2008
LTV at LTC
I've written quite a bit about unsuccessful Information Engineering projects; now I want to write about a successful one.
How can you change a company? Give people the information they need to make decisions they never thought they could and that changes how they think about the enterprise. The trouble is, any organization will put up a lot of resistance to change.
In 2002 I managed a Life-Time Value (LTV) project at a Large Telecommunications Company (LTC) that did change the enterprise. LTV is an attempt to measure the overall economic impact of each customer to the enterprise over their expected life. Ideally this is concrete numeric data so we can ask “Is this customer worth $300 in new equipment for them if they will stay with us for two more years”?
The LTV project allowed people to think about the business in new ways, the project was embraced by the Chief Marketing Officer, and the project saved $15 million each year in direct marketing costs while adding to the revenue from marketing programs simply by not spending money to retain customers that LTC was losing money on.
There are a lot of articles about how to do LTV calculations. This time I want to talk about all the corporate politics around sheparding the LTV project to success.
How can you change a company? Give people the information they need to make decisions they never thought they could and that changes how they think about the enterprise. The trouble is, any organization will put up a lot of resistance to change.
In 2002 I managed a Life-Time Value (LTV) project at a Large Telecommunications Company (LTC) that did change the enterprise. LTV is an attempt to measure the overall economic impact of each customer to the enterprise over their expected life. Ideally this is concrete numeric data so we can ask “Is this customer worth $300 in new equipment for them if they will stay with us for two more years”?
The LTV project allowed people to think about the business in new ways, the project was embraced by the Chief Marketing Officer, and the project saved $15 million each year in direct marketing costs while adding to the revenue from marketing programs simply by not spending money to retain customers that LTC was losing money on.
There are a lot of articles about how to do LTV calculations. This time I want to talk about all the corporate politics around sheparding the LTV project to success.
Subscribe to:
Posts (Atom)