The sheer volume of web data available today is both a blessing and a curse. This data presents businesses with endless opportunities for deriving valuable insights, but the challenge lies in efficiently processing and analyzing this information. Many companies have turned to large language models (LLMs) like ChatGPT to analyze and summarize massive volumes of web data.
ChatGPT recently introduced a new “web browsing” plug-in feature, currently in alpha. This feature connects to the internet, converting the user prompt into a search query that returns summaries based on Bing API’s search results. While this is a promising new ChatGPT capability, it has its limitations. For example, the browsing plug-in is limited to the web content indexed by Bing. On the other hand, Webz.io provides data from sources across the open, deep, and dark web. You can unlock a wealth of knowledge by combining the raw data from Webz.io with the natural language processing (NLP) capabilities of ChatGPT.
This article will discuss how you can use this powerful duo for data analysis and insight generation. We’ll use a financial report as an example and explore other use cases. Before we begin, here is a quick explainer of what Webz.io is, what ChatGPT is, and why you would automate financial analysis.
What is Webz.io?
Webz.io is the link to accessing rich and diverse web data at scale. Webz.io’s APIs provide access to a vast array of web data from multiple sources, including news articles, blogs, forums, and reviews. You can create customized Boolean queries to filter the information, ensuring you gather only the most relevant and valuable data for your needs. The ability to extract specific information from a wide range of sources makes Webz.io an ideal starting point for any data analysis project.
What is ChatGPT?
ChatGPT is a tool that can transform raw data into meaningful insights. It is a powerful large language model developed by OpenAI that can process and analyze large volumes of textual data. Utilizing its NLP capabilities, you can transform raw data into actionable insights, summaries, and predictions. You can also use ChatGPT to identify key trends, patterns, and relationships within the data, making it an invaluable tool for data-driven decision-making.
Generating automated financial analysis reports with Webz.io and ChatGPT
By combining the power of ChatGPT with Webz.io data, you can efficiently analyze large volumes of financial news data and obtain actionable insights on investment opportunities. We’ve created a Python script that generates a financial report that provides information on:
- Trends and themes — ChatGPT will identify recurring themes in the summaries, such as growing industries, emerging markets, or disruptive technologies.
- Key companies — ChatGPT will highlight companies frequently mentioned for their strong performance, innovative products, or competitive advantages.
- Investment opportunities — The report will include insights on companies with solid growth potential or undervalued assets.
While the script focuses on financial investment opportunities, you could use this script to generate reports for other industries. I’ve outlined additional use cases later in the article. Creating the automated report takes three steps. Using Python or your preferred language, you create a script that executes the following steps:
- Step #1 – Query the Webz.io API. Retrieve a filtered list of news articles by querying the Webz.io API
- Step #2 – Use ChatGPT API to summarize article text. Use ChatGPT API to summarize the text of each news article retrieved by the Webz.io API
- Step #3 – Generate prompt for ChatGPT. Fetches articles and summarizes them using ChatGPT. The final step generates a prompt for ChatGPT to create the report.
The following section includes a financial report example and the Python script that created it.
Financial report example and Python script
The financial analysis report and script demonstrate the synergy between Webz.io and ChatGPT. They show how you can streamline the process of creating a comprehensive financial report through automation. And you can create financial reports based on a wide range of data sources. As mentioned above, it takes three steps to generate a financial report, which the script executes through these functions:
Step #1: fetch_posts()
This function retrieves the news articles from the Webz.io API based on the given query.
The Webz.io API provides a comprehensive source of news articles based on specific Boolean queries. For our financial report, we used the following query:
(site_category:financial_news OR site_category:financial_planning) domain_rank:<1000 site_type:news language:english social.facebook.likes:>0 invest
This query allows us to filter news articles from top-ranked financial news websites, written in English, and with positive social media engagement. It also focuses on articles discussing investments.
Step #2: summarize_article(text)
This function takes the article text as input and generates a summary using ChatGPT API. The script asks ChatGPT to provide essential information such as company names, market trends, industry, asset class, region, and investment opportunities.
Step #3: main()
This function fetches the selected articles, trimming their length if needed. It then summarizes the articles. The final step of the script generates a prompt for ChatGPT to act as a financial analyst. The prompt asks ChatGPT to write an investment opportunity report based on the news article summaries. The prompt also asks that the report include trends and themes, identify recurring themes, and note any patterns that might reveal potential investment opportunities.
By using a specific Boolean query, Webz.io can provide relevant financial news articles. ChatGPT can then analyze and summarize the articles, creating the investment opportunity report.
The Python script
Here is the full Python script if you want to play around with it. Click on the code snippet to view the entire script. Option to copy the script to the clipboard.
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 |
import os import requests import openai Webz.io_API_KEY = "XXX-XXXX-XXXX-XXXXX" openai.api_key = os.getenv("OPENAI_API_KEY") def trim_string(string, max_length): if len(string) > max_length: return string[:max_length] else: return string # Function to get news articles from Webz.io API def fetch_posts(): endpoint = f"https://api.webz.io/filterWebContent?token=XXXX-XXXX-XXXXX&format=json&sort=crawled&q=(site_category%3Afinancial_news%20OR%20site_category%3Afinancial_planning%20OR%20site_category%3Afinancial_planning)%20domain_rank%3A%3C1000%20site_type%3Anews%20language%3Aenglish%20social.facebook.likes%3A%3E0%20invest&size=50" response = requests.get(endpoint) data = response.json() return data["posts"] # Function to interact with ChatGPT API def chat_gpt_request(prompt, model): response = openai.Completion.create( model=model, prompt=prompt, temperature=0, max_tokens=1000, top_p=1, frequency_penalty=0, presence_penalty=0 ) return response.choices[0]["text"].strip() # Function to summarize article text using ChatGPT API def summarize_article(text): prompt = f"Summarize the following article. Provide key information such as company names, market trends, industry, asset class, region, investment opportunities.:\n\n{text}\n\nSummary:" summary = chat_gpt_request(prompt, "text-davinci-003") print(summary) return summary # Main function to fetch and summarize articles def main(): articles = fetch_posts() summaries = [] for article in articles: text = trim_string(article["title"] + "\n\n" + article["text"], 14000) summary = summarize_article(text) summaries.append(summary) summaries = "\n\n***\n\n".join(summaries) summaries = trim_string(summaries, 14000) prompt = f"Act as a financial analyst. Write an investment opportunity report based on the following news article summaries separated by '***' separator. Each summary contains key information such as company names, market trends, industry, asset class, region, investment opportunities. The report will include trends and themes, identify recurring themes, such as growing industries, emerging markets, or disruptive technologies. Note any patterns that might reveal potential investment opportunities. Identify key companies. As you analyze the summaries, take note of companies frequently mentioned or highlighted for their strong performance, innovative products, or competitive advantages. For each company of interest, take into account their fundamentals, management team, competitive position, and performance. Look for companies with strong growth potential or undervalued assets. \n\nSummaries:\n\n" + summaries + "\n\nReport:" print("\n\n------ Prompt -------------\n\n") print(prompt) if __name__ == "__main__": main() |
The investment opportunities report and ChatGPT prompt
Below is an investment opportunity report generated by our Python script. Click on the bar below to see the full report.
Click for the full report
Investment Opportunity Report: May 2023
This report analyzes recent news articles to identify potential investment opportunities. Trends and themes have been identified, and key companies have been analyzed.
Trends and Themes:
- Banking sector oversight is being sharpened by regulators in the US, presenting investment opportunities in banks that prioritize risk management and compliance.
- Animal welfare concerns and court rulings are impacting the live cattle export industry in Brazil, potentially affecting companies that rely on this market.
- With economic downturns looming, investing in consumer staples stocks, precious metals, healthcare sector stocks, government bonds, and crypto could prove wise.
- The enforcement of foreign exchange laws in India is impacting major edtech company Byju’s, while student loan forgiveness plans in the US are being considered by the Supreme Court.
- The retail sector is seeing growth in dollar stores, while broadcasting stocks and subway are presenting opportunities in the private market.
Key Companies:
- New York Community Bancorp (NYCB) reported strong revenue for Q1 2023, presenting potential opportunities for investment in the banking sector.
- Brazilian food company Minerva may be impacted by the recent court ruling banning the export of live cattle from all ports in Brazil.
- Investing in companies such as Coca-Cola, L’Oreal, Walmart, and gold and silver, as recommended by Thomas Kralow, could provide strong growth potential.
- Edtech giant Byju’s is being investigated for foreign exchange law violations in India, potentially impacting its stock price.
- The potential for student loan forgiveness in the US could impact the financial industry.
- Subway is exploring a sale, presenting potential opportunities for private equity firms.
- Synaptics Inc. (SYNA) and Fiserv Inc. (FISV) are both companies worth considering for investment in the technology and financial services sectors, respectively.
Overall, the banking sector, consumer staples stocks, precious metals, healthcare sector stocks, government bonds, and the private market all present potential investment opportunities. As always, it’s important to take into account a company’s fundamentals, management team, competitive position, and performance before making any investment decisions.
Below is the full ChatGPT prompt that created the report. Click on the bar to see the whole prompt.
Click for the full ChatGPT prompt
Act as a financial analyst. Your task is to write an investment opportunity report based on the following news article summaries seperated by ‘***’ seperator.
– Each summary contains key information such as company names, market trends, industry, asset class, region, investment opportunities.
– The report will include trends and themes, identify recurring themes, such as growing industries, emerging markets, or disruptive technologies. Note any patterns that might reveal potential investment opportunities.
– Identify key companies. As you analyze the summaries, take note of companies frequently mentioned or highlighted for their strong performance, innovative products, or competitive advantages. For each company of interest, take into account their fundamentals, management team, competitive position, and performance.
– Look for companies with strong growth potential or undervalued assets.
Summaries:
New York Community Bancorp (NYCB) reported $652 million in revenue for the quarter ended March 2023, representing a year-over-year increase of 88.4%. EPS of $0.23 for the same period compares to $0.32 a year ago. The reported revenue compares to the Zacks Consensus Estimate of $602.97 million, representing a surprise of +8.13%. The company’s efficiency ratio was 60.48%, net interest margin was 2.6%, average balances-interest earning assets was $86.67 billion, net interest income was $555 million, bank-owned life insurance was $10 million, fee income was $27 million, other non-interest (loss) income was $11 million, net gain on loan sales and securitizations was $20 million, and net return on mortgage servicing rights was $22 million. Shares of New York Community Bancorp have returned +2.5% over the past month. The stock currently has a Zacks Rank #3 (Hold).
***
US regulators have vowed to sharpen their oversight of the banking sector after the Federal Reserve and Federal Deposit Insurance Corporation detailed their supervisory lapses before the collapse of Silicon Valley Bank and Signature Bank in March. First Republic Bank was on the brink of collapse due to a $100 billion deposit run triggered by the SVB and Signature failures. The Fed and FDIC released reports detailing their failings in the collapse of the two banks, and both reports identified supervisory misjudgments and the banks’ managers prioritizing growth and ignoring basic risks. The Fed is considering tying executive compensation to prompt fixes, and the FDIC is looking to fill vacant positions in the large bank supervisory staff in the New York region.
***
A Brazilian court has issued a ruling banning the export of live cattle from all ports in the country due to animal welfare concerns. The ruling was handed down by federal judge Djalma Gomez and can be appealed. Animal rights groups have hailed the ruling as historic, as it acknowledges the suffering caused to animals by activities akin to human trafficking during slavery. Brazil’s Agriculture Minister Carlos Favaro has said the court order must be complied with, but defended the live cattle trade in Brazil. Brazilian food company Minerva, a major South American beef supplier and live cattle exporter, has not yet commented on the decision.
***
Thomas Kralow, a self-made millionaire and founder of University Grade Trading Education, recommends investing in consumer staples stocks, precious metals, healthcare sector stocks, government bonds, crypto, and yourself during an economic downturn. He suggests investing in companies such as Coca-Cola, L’Oreal, Walmart, gold and silver, stocks in the healthcare sector, government bonds, and blue chip cryptocurrencies such as Bitcoin and Ethereum. He also recommends investing in yourself by taking courses, seeking mentorship, and networking.
***
India’s Enforcement Directorate (ED) conducted searches at three premises of edtech giant Byju’s and its founder Byju Raveendran, seizing various documents and digital data. The investigation was prompted by complaints from private individuals and found that Byju’s had raised about $3.4 billion in foreign direct investment and remitted about $1.1 billion to foreign entities during the period of 2011 to 2023. Byju’s termed the searches as “a routine inquiry” and said they maintain complete transparency with the authorities. ED’s statement comes at a time when Byju’s is closing a large funding round and is gearing up for the IPO of its subsidiary unit physical tutor chain Aakash.
***
OpenAI, a startup behind the widely used conversational AI model ChatGPT, has completed a $300 million equity sale at a valuation of $27-29 billion. The investment was led by VC firms including Tiger Global, Sequoia Capital, Andreessen Horowitz, Thrive and K2 Global, with the Founders Fund also investing. This is separate from a $10 billion investment from Microsoft announced earlier this year. OpenAI now has over 30% of its shares owned by outside investors. OpenAI has many technical teams working in different areas, including GPT (Generative Pre-trained Transformer) and ChatGPT, a generative AI service released in November 2022. Microsoft is integrating OpenAI’s API with Azure infrastructure to power Bing.
***
Indian education platform Byju’s, once valued at $22 billion, is being investigated by India’s Enforcement Directorate for alleged foreign exchange law violations. The agency has revealed that Byju’s parent firm Think & Learn Pvt Ltd had received foreign direct investment of nearly 280 billion rupees ($3.43 billion) between 2011 and 2023, and remitted 97.5 billion rupees to various foreign jurisdictions between 2011 and 2023 in the name of overseas direct investments. Byju’s CEO is confident that the company is compliant with foreign exchange laws and has taken all efforts to comply with them. The company has submitted the required documentation and statutory filings to the Enforcement Directorate.
***
The stock market has been relatively calm despite the Federal Reserve’s interest rate increases and worries about regional banks slowing lending and contracting the economy. This has sparked debate among investors about the Fed’s tightening policies. Companies mentioned include Dow Jones & Company, TurboTax, The Motley Fool, H&R Block, Top Resume, eBay, and Groupon. Investment opportunities include coupon codes for TurboTax, H&R Block, Top Resume, eBay, and Groupon.
***
This article provides advice on which renovations to make and which to skip when preparing a house for sale. Experts suggest focusing on bathrooms, such as adding oversized medicine cabinets and double vanities, and kitchen upgrades, such as painting and new counters and backsplash. They also suggest adding paint, upgrading garage doors, and making lighting improvements. On the other hand, they advise against adding a sunroom, pool, bidet, custom upgrades, and anything built-in. They also suggest skipping big-ticket fixes, such as a new driveway, and not spending too much on curb appeal. Finally, they recommend having a roof inspected, but not necessarily replacing it.
***
State Street, Annexus Retirement Solutions, and Global Trust Company have partnered to launch a new series of target-date funds that offer a lifetime income product embedded directly in their glide paths. The State Street GTC Retirement Income Builder Series will allow retirement savers to convert a portion of their savings into a pension-like income stream for life. The funds will shift a portion of assets into an annuity when the saver hits age 47 and monthly payments from the annuity will begin at age 65. The funds will cost 0.10% per year and 0.20% after savings are converted into an annuity. Financial advisors can help retirement savers decide how to invest their retirement assets and what financial products are best suited for their needs. SmartAsset’s retirement tax-friendliness tool can also help determine which states are right for retirement based on their tax friendliness.
***
The Supreme Court is currently deciding on a federal student loan forgiveness plan that could provide up to $10,000 in loan forgiveness for individuals earning less than $125,000 and couples earning less than $250,000. The Supreme Court is expected to issue a final decision on the loan forgiveness plan by June 30. If the justices decide in favor, borrowers may start receiving student loan forgiveness within weeks. The Biden administration has also announced the IDR Adjustment, a one-time initiative that will give millions of borrowers retroactive credit toward student loan forgiveness under income-driven repayment (IDR) plans, with an effective date of December 31. Borrowers should have all relevant documents in hand by June 30 in case the court rules in its favor.
***
In an exclusive interview with CNBC, BuzzFeed CEO Jonah Peretti discussed the company’s struggles since going public in December 2021. The stock has fallen 95% since then and has traded below $1 for more than a week, putting the company at risk of delisting. Peretti is confident in his leadership and plans to boost stock value by incorporating more artificial intelligence into the company’s content and shutting down the money-losing newsroom. He also believes news websites will see a resurgence as social media companies turn away from news. Peretti has no plans to step down as CEO or sell the company. He hopes to convince shareholders of his vision at the company’s investor day on May 11.
***
Synaptics Inc. (SYNA) is a semiconductor company based in San Jose, CA. It specializes in custom-designed human interface solutions for electronic devices and products. SYNA’s stock price is currently $88.56, down 0.26% from the previous close. Analysts have recently given the stock a range of ratings from Buy to Hold. SYNA is part of the semiconductor industry and the Nasdaq asset class. Investment opportunities in the semiconductor industry are discussed in a recent article on Benzinga.com.
***
Fiserv Inc. (FISV) is a financial services technology company based in Brookfield, WI. It operates through three segments: Merchant Acceptance, Financial Technology, and Payments and Network. FISV stock price is currently at $122.17, with a market cap of $75.39B and 617.31M shares outstanding. Analysts have recently given the stock a buy rating, and the company has reported positive earnings and revenue estimates for Q1. Fiserv provides technology solutions to financial institutions and corporate clients, enabling them to process customer deposit and loan accounts, digital payment transactions, and commerce enabling solutions.
***
Democratic Senator Bernie Sanders and other lawmakers have reintroduced The Social Security Expansion Act to Congress, which would provide an extra $200 in each monthly check for current Social Security recipients and those who will turn 62 in 2023, amounting to an additional $2,400 a year in benefits. The bill also proposes to tax the highest earners in the country to ensure future generations can receive benefits through 2096. Republican leaders have stated that they are not interested in cutting Social Security or Medicare. The bill aims to ease the financial strain of seniors living on fixed incomes, many of whom rely solely on Social Security payments. The bill has been endorsed by more than 50 organizations.
***
A recent study reported by GOBankingRates found that dollar stores have become the fastest growing retail segment for grocery shopping, increasing by 1%. TikTok account Dollar Tree Dinners recently revealed some incredible bargains at Dollar Tree, such as Sunkist Orange Peach Mango Drink Powder, Stove Top Stuffing, Chicken of the Sea Crabmeat, Seaweed, and Splenda Coffee Creamer, which are all cheaper than at Target. Dollar Tree prices beat out competitors for these items, but Target offers a better deal for the Splenda Coffee Creamer in the 32 oz. size.
***
Mario Gabelli, CEO and Chairman of Gamco Investors, discussed his best deals of his decades-long career at the Morningstar Conference in Chicago. He discussed two broadcasting stocks, Chris-Craft and Lin Broadcasting, which were eventually acquired by News Corporation and earned him at least ten times his original stake. Gabelli discussed the concept of private market value, which is valuing a company based on how much an individual is willing to pay for its listing price on an exchange. He believes this concept is global and is about finding companies with pricing power, great management, and great business at a reasonable price.
***
Subway is exploring a sale and has received bids ranging from $8.5 billion to $10 billion. JPMorgan Chase & Co has put forward a $5 billion debt financing package to show buyout firms they can borrow enough to structure an attractive deal at a $10 billion-plus valuation. The debt financing is based on a mix of loans and bonds and is equivalent to 6.75 times Subway’s 12-month earnings before interest, taxes, depreciation and amortization. Private equity firms such as Bain Capital, TPG Inc, Advent International Corp, TDR Capital, Goldman Sachs Group Inc’s buyout arm and Roark Capital are participating in the auction. Barclays Plc is in discussions about long-term financing. Subway is revamping its operations and has launched a menu overhaul and marketing campaign to help sales grow.
***
Asian markets were mixed on Monday, with Australia and Japan rising while most were closed for Labor Day. Sony shares fell as much as 4.8% after guidance missed expectations, while South Korea’s exports fell for the seventh month in a row. Australia’s inflation rate is expected to hold steady at 3.6%, while Japan’s manufacturing activity saw a milder contraction in April. China’s factory activity unexpectedly eased in April, and CNBC Pro reported on what history suggests is in store for US and global stocks in May. Friday’s PCE data gave the Federal Reserve reason to raise rates again, according to an investment adviser. The Core PCE price index rose in line with expectations, and consumer-focused stocks were among the biggest gainers this week. Sources say the First Republic is likely headed for judicial administration, and energy and consumer staples stocks led the S&P 500 this month.
***
Oil prices dropped on Monday due to jitters over the economic impact of the U.S. Federal Reserve potentially raising interest rates and weaker Chinese manufacturing data. The OPEC+ group announced a surprise output cut of 1.16 million barrels per day, which is expected to drive prices higher through the remainder of the second quarter. The U.S. Federal Reserve is expected to increase interest rates by 25 basis points this week, while the Reserve Bank of Australia is expected to extend a rate hike pause on Tuesday and the European Central Bank could surprise with an outsized half-point increase on Thursday.
Other ways you can use Webz.io with ChatGPT
The combination of Webz.io and ChatGPT is not limited to financial analysis — the possibilities are endless. Some other use cases include:
- Market research — You can gather and analyze information on competitors, customers, and industry trends to make informed business decisions.
- Content curation — You can create personalized newsletters or blog posts by filtering and summarizing articles on specific topics.
- Crisis management — By monitoring news articles and social media posts, you can quickly identify potential crises and formulate appropriate responses.
- Product development — By analyzing customer feedback, reviews, and market trends, you can identify opportunities for new products or improvements to existing ones.
It should be noted that large language models like ChatGPT can make mistakes. So when generating analyses with Webz.io and ChatGPT, you should cross-check the results with other sources. An automated report is another source of information meant to help the user gather quick insights at scale.
Webz.io and ChatGPT = powerful insights from web data
Combining Webz.io’s rich data sources and ChatGPT’s NLP capabilities gives you a powerful data analysis and insight generation solution. The financial report example highlights the potential of this duo, and the applications are vast and varied. Businesses and individuals can harness the power of Webz.io and ChatGPT to make data-driven decisions, unlock new opportunities, and stay ahead in today’s competitive landscape.
Ready to get started? If you don’t have access to Webz.io’s APIs yet, speak to one of our data experts now.