Just a quick note that with the latest caching and multithreading improvements we have added a whole slew of tickers – not blue chips but less tumultuous ETFs and penny stocks – to the tracking spreadsheet.
Developing microservices for pleasure and profit works when it doesn’t cost anything to do so. After our last month of developing a tone analysis system using IBM Watson on BlueMix, I tallied up quite a few queries and as a result got a bill from BlueMix for a whole 9 cents.
Problem – Tone Analysis is Too Slow
Currently we fetch a list of the latest 20 news stories for a stock ticker and then iterate through the list sequentially scraping the content and then submitting that scrape to the IBM Watson tone analysis service. As a result we have a time of O(n) to process a list of URLS.
Just a quick update for those of you following our stock sentiment analysis system, I have provided an updated spreadsheet on the statistics for our 5 case study stocks here. I will be updating the values for the 5 stocks on an every few days basis.
I figured I would go off and run the tool on a few prominent tickers, make a prediction for a time period, and revisit later to see how those predictions fared.
Keep in mind, this is rather unscientific. I’ll be updating throughout the day as the analysis finish. Largely a task illustrating how long this takes to do without architectural enhancements we do in upcoming steps.