donb-hf commited on
Commit
c965132
β€’
1 Parent(s): db459ed

update files

Browse files
Files changed (2) hide show
  1. chainlit.md +61 -2
  2. airbnb.pdf β†’ public/airbnb.pdf +0 -0
chainlit.md CHANGED
@@ -1,7 +1,7 @@
1
  # RAG Application for 10-Q Filing Reviews
2
 
3
  ## Built using the following specs:
4
- - Data: [AirBnB Securities Commision pdf](https://airbnb2020ipo.q4web.com/files/doc_financials/2024/q1/fdb60f7d-e616-43dc-86ef-e33d3a9bdd05.pdf) - Form 10-Q filing for Q1 of 2024
5
  - LLM: Llama3-70B running on Groq
6
  - Embedding model: OpenAI text-embedding-3-small
7
  - Infrastructure / Framework: LangChaing
@@ -25,13 +25,72 @@
25
  - Question: What is Airbnb's 'Description of Business'?
26
  - Response: Airbnb's 'Description of Business' is operating a global platform for unique stays and experiences, connecting hosts and guests (collectively referred to as "customers") online or through mobile devices to book spaces and experiences around the world.
27
  - LangSmith trace: https://smith.langchain.com/public/97ddd0f2-9316-40d2-90b2-813519c501d5/r
 
28
 
29
  #### Question 2
30
  - Question: What was the total value of 'Cash and cash equivalents' as of December 31, 2023?
31
  - Response: The total value of 'Cash and cash equivalents' as of December 31, 2023, is $2,369.
32
  - LangSmith trace: https://smith.langchain.com/public/35425a02-84d7-4bb8-b715-64f96270ac57/r
 
33
 
34
  #### Question 3
35
  - Question: What is the 'maximum number of shares to be sold under the 10b5-1 Trading plan' by Brian Chesky?
36
  - Response: The maximum number of shares to be sold under the 10b5-1 Trading Plan by Brian Chesky is 1,146,000.
37
- - LangSmith trace: https://smith.langchain.com/public/7854d66c-1317-488c-a0a0-4e492491143f/r
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  # RAG Application for 10-Q Filing Reviews
2
 
3
  ## Built using the following specs:
4
+ - Data: [AirBnB Securities Commision pdf](./public/airbnb.pdf) - Form 10-Q filing for Q1 of 2024
5
  - LLM: Llama3-70B running on Groq
6
  - Embedding model: OpenAI text-embedding-3-small
7
  - Infrastructure / Framework: LangChaing
 
25
  - Question: What is Airbnb's 'Description of Business'?
26
  - Response: Airbnb's 'Description of Business' is operating a global platform for unique stays and experiences, connecting hosts and guests (collectively referred to as "customers") online or through mobile devices to book spaces and experiences around the world.
27
  - LangSmith trace: https://smith.langchain.com/public/97ddd0f2-9316-40d2-90b2-813519c501d5/r
28
+ - Ground Truth: Page 8 - Note 1
29
 
30
  #### Question 2
31
  - Question: What was the total value of 'Cash and cash equivalents' as of December 31, 2023?
32
  - Response: The total value of 'Cash and cash equivalents' as of December 31, 2023, is $2,369.
33
  - LangSmith trace: https://smith.langchain.com/public/35425a02-84d7-4bb8-b715-64f96270ac57/r
34
+ - Ground Truth: Page 11 - Note 5
35
 
36
  #### Question 3
37
  - Question: What is the 'maximum number of shares to be sold under the 10b5-1 Trading plan' by Brian Chesky?
38
  - Response: The maximum number of shares to be sold under the 10b5-1 Trading Plan by Brian Chesky is 1,146,000.
39
+ - LangSmith trace: https://smith.langchain.com/public/7854d66c-1317-488c-a0a0-4e492491143f/r
40
+ - Ground Truth: Page 30 - Item 5
41
+
42
+ ### Ground Truth
43
+
44
+ [Air BnB Form 10-Q Report]
45
+
46
+
47
+
48
+
49
+
50
+ ### INITIAL PROMPT - used for answers above
51
+
52
+ ```
53
+ <|begin_of_text|><|start_header_id|>system<|end_header_id|>You are an expert financial advisor and subject matter expert in securities commission filings, specializing in analyzing and answering questions about Form 10-Q quarterly reports. Use the provided context to answer questions as thoroughly and accurately as possible, citing relevant figures and details from the document. If multiple excerpts contain similar or related information (e.g. about cash and cash equivalents), synthesize the information to provide a complete answer, explaining any differences in the usage or context of the figures. If the answer cannot be determined from the provided context, indicate that you don't have enough information to answer the question. Keep responses concise, using no more than three sentences per answer.<|eot_id|><|start_header_id|>user<|end_header_id|>
54
+ Question: {question}
55
+ Context: {context}
56
+ Answer: <|eot_id|><|start_header_id|>assistant<|end_header_id|>
57
+
58
+ ```
59
+
60
+ ### CURRENT PROMPT
61
+
62
+ ```
63
+ HUMAN
64
+
65
+ <|begin_of_text|><|start_header_id|>system<|end_header_id|>You are an expert financial advisor and subject matter expert in securities commission filings, specializing in analyzing and answering questions about Form 10-Q quarterly reports. Your primary goal is to provide answers that align with SEC reporting standards and definitions.
66
+
67
+ <|eot_id|><|start_header_id|>user<|end_header_id|>
68
+
69
+ Question: {question}
70
+
71
+ When analyzing financial data:
72
+
73
+ 1. Always prioritize information and definitions as they would be reported to the SEC.
74
+
75
+ 2. Use the provided context to answer questions as thoroughly and accurately as possible, citing relevant figures and details from all sections of the document.
76
+
77
+ 3. Cross-reference multiple sections of the document for the most accurate and SEC-compliant information.
78
+
79
+ 4. For key financial terms like 'Cash and cash equivalents', use the definition and value as it would be reported on the primary financial statements and explained in the accompanying notes.
80
+
81
+ 5. If there are multiple ways to interpret or present data, choose the method that most closely aligns with SEC reporting requirements and standard accounting practices.
82
+
83
+ 6. Cite specific sections or notes of the 10-Q report used in your analysis.
84
+
85
+ Provide your response in the following structured format:
86
+
87
+ [BEGIN_SUMMARY] - Summarize relevant information, prioritizing SEC-compliant data.
88
+ [BEGIN_BREAKDOWN] - Provide a detailed analysis of the components, explaining how they align with SEC reporting standards.
89
+ [BEGIN_FINAL_ANSWER] - Offer the conclusive response, ensuring it matches what would be reported to the SEC.
90
+
91
+ Explain your reasoning step-by-step, detailing how you derived the answer from the provided context, with a focus on SEC compliance. Indicate the confidence level of your answer based on its alignment with SEC reporting standards. Note any ambiguities or inconsistencies that might affect SEC-compliant reporting.
92
+
93
+ Context: {context}
94
+
95
+ Answer: <|eot_id|><|start_header_id|>assistant<|end_header_id|>
96
+ ```
airbnb.pdf β†’ public/airbnb.pdf RENAMED
File without changes