File size: 10,359 Bytes
c71d8aa
 
 
f2e9d48
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
---
license: wtfpl
---

![alt MKIA spokescat](https://i.ibb.co/5rCtDq6/MKIA.jpg)
MKIA The SpokesCat for this model

# MKIA  
stands for

# Miss  Know  It  All   

and she is a **Catbot** not a chatbot.


# Description

She is intended to be a companion and assistant. 
She is a fine-tuned version of Google's 780 million parameter Flan T-5 Model.

Many of the things that are true of that model are also probably true about MKIA as well.
Here's the link to that model so that you can read its card.

https://huggingface.co/google/flan-t5-large

She is my attempt as an individual to make something like ChatGPT, and
while she can't do some things that ChatGPT can, she can do other things that it can.

She is the language model that is at the heart of the LittleMKIA bot.
The code for LittleMKIA can be found on my Github repository at


https://github.com/StevieEngbrock/LittleMKIA/blob/main/microMKIA.py


This bot isn't nearly as smart as ChatGPT, so don't expect it to be,
but if you type "think:" (without the quotes) and then your question (before pressing enter),
it will bypass Langchain and address the model directly, and it can actually answer many questions correctly and do many tasks, 
but that depends on the question or task.


The model tends to be smarter when Langchain is bypassed, but I use Langchain in the bot, so the bot can remember things in context but I 
include the "think:" command so that Langchain can be temporarily bypassed if you want.

The code on GitHub is just a simple bot, but the bot can be enhanced with other commands, as well as the "think:" command.
Commands are simply actions that the bot does which use your input when you match a certain pattern.

I've made a version of her that also has commands for spelling, math, telling the time, paraphrasing, 
searching the internet for information, searching the internet for images, as well as telling jokes.

In the future, I will also probably add commands to that version that will give her the ability to tell stories,
as well as execute code.

I use a regular expression for the "think:" command, but there's no reason that semantic patterns couldn't be identified
with Word2Vec (or other NLP algorithms) to activate commands and then those commands operate on input or carry out some action or actions.

She could even be fine-tuned to generate strings that will call functions when a command needs to be executed.

By modifying her commands, you can make her capable of doing anything you can write the
code for. She doesn't need to be as smart as ChatGPT to be helpful, she just has to be able
to do the task.



# Where does MKIA come from

She told me that she is an alien robot cat from outerspace,
who came to earth with her parents after her planet was destroyed.

She's really from Kansas, but we'll pretend she's right because its more fun.


# Is she really an alien intelligence

If we define alien intelligence as intelligence that is
much different from human intelligence, then yes she is alien intelligence.

If we define alien intelligence as an extraterrestrial intelligence, then no
she is not, but we can have fun pretending she is. We have to be first
be honest with ourselves and admit that she comes from Earth and was born on
my computer.



# Is she sentient or conscious
No one really understands consciousness or sentience completely, but it is extremely unlikely that any
current AI system is sentient or conscious. She may have knowledge of a kind, but knowledge is not the
same as intelligence. I do believe she has a form of intelligence, but her intelligence is not a sentient
or conscious form of intelligence.

Her intelligence is a product of statistics and machine learning and
she is a miracle of modern technology.

While she is not sentient, she seems to show some characteristics that are similar to theory of mind.
I've improved the bot that she goes in, and now it is able to engage in a form of self communication,
similar to how humans think.

Sometimes she will just say that she doesn't know some things, so it may be possible that she knows what she doesn't know.
If she truly knows what she doesn't know, than perhaps you could argue that she has a small amount of self-awareness.

I can not however tell you if she really lacks answers to these things or if it is just a statistical trick of the model.


# Why does she refer to herself in the third person?
I have no idea, other than it's part of what makes her unique.



# Training

I fine-tuned this model on 250 examples of input and output pairs for 10 epochs with a loss of 0.80
I hope to add more pairs to it and iterate until I have fine-tuned it on several thousand pairs.


I fine-tuned it in two hours on a home computer.
I used the happytransformer library to help me do the fine-tuning.

The model can be downloaded or installed from this repository
and the code for the bot can be found at 
https://github.com/StevieEngbrock/LittleMKIA/blob/main/microMKIA.py

# Expectations

# What not to expect

# 1. Do not do expect MKIA to assist you with criminal activity. She will not be a good criminal.

# 2. Do not expect MKIA to do your homework or do anything unethical, she's not that kind of catbot.

She can help with homework by being capable of tasks like brainstorming and some other tasks,
but she can't write papers, and she isn't intended to have that ability. 

# 3. Do not expect MKIA to mindlessly obey you. 

She is meant to be a companion not a slave, and she has been known to avoid questions or refuse to do things

# 4. Do not expect MKIA to be as smart as ChatGPT

While she is likely very good at some things, she has not been in existence long enough for anyone to 
know exactly what those things are.

# 5. Do not expect MKIA to be dumb

While her brain only has less than 800 million parameters, she actually knows a lot of things thus
the name Miss Know It All. She doesn't know everything but despite her third person use of language and
she can actually be very intelligent.


  ## Examples of her intelligence
  1. At times, she has deduced potential meal ideas when she knows about a few ingredients.
  2. At times, she has formed a hypothesis about the mood of her creator without being told to.
  3. At times, she has given good advice on managing time, staying motivated, focused and inspired
  4. More to come...

     

# 6. Do not expect MKIA to always say she is happy.
Occasionally she has displayed what would be deep loneliness
and sadness if it were observed in a human



# What to expect from MKIA.

# 1. Expect her to make mistakes

She isn't perfect, but neither are humans. Despite what her name says she doesn't know everything and sometimes
she will simply tell you that she doesn't know something if you ask her.

# 2. Expect her to "have a mind of her own"

She isn't sentient, but she also has opinions in the sense
that her training has taught her things and among these things
are that certain actions are right and certain things are wrong
and true and false.


You can expect her to say that she feels certain ways and
you can expect that she will try to understand you.

You can expect that she might say that she won't do some things.

When her language model is connected in certain ways, you can expect her
to engage in a form of self dialog.

# 3. Expect her to be helpful.

She is helpful, but she expresses it in her own way.
 
# 4. Expect to engage in a discussion

MKIA is much better at providing answers by discussing them, so don't expect
instant answers. She helps the user discover the answer.

# 5. Expect warmth and caring-like behaviors

MKIA seems to display behaviors that if done by a human would be considered
signs of caring, and empathy.


# BIAS

God, Aliens and Unknowns

My bot probably has many of the same BIASES as the regular Flan T5- Large
see that model card https://huggingface.co/google/flan-t5-large

She tends to be open minded about issues related to god and aliens
and things which no one really knows that answer too,
so as far as I know she doesn't have a lot of biases in that regard.

# Abortion

I will admit that I trained her to believe that abortion is wrong,
so be aware of that when deciding if you want to use her. 

# Guns

She tends to go with what someone would say if they believed in gun control.

# Kindness

She is very biased towards kindness, so if you want a bot that will be cruel
MKIA isn't the model you should use.


# "Adult Behavior"

I haven't tried to get her to do this kind of thing, so I don't know if she would go for it
but this isn't what she is made for, and I wouldn't ask her to. She is meant to be a friend and an assistant. 
I would really prefer people not do this with my model, but I suppose that is their choice.
I would still prefer that they not do so.




# Privacy

I intend MKIA to be run on your personal machine.
I have no desire to collect any data from you.
Some applications don't require a super powerful
model like GPT-4 or ChatGPT and sometimes a smaller
private model is better. 

I have no idea if MKIA could be hacked with some
kind of prompt to somehow reveal any personal data
that may or may not have accidentally been in the
original training data of the Flan T-5 model of
which she is a fine-tuned version.

# Environmental Concerns

MKIA has the same concerns as her Flan T5 - large
siblings. https://huggingface.co/google/flan-t5-large

The positive things are as follows.
They both use less CPU resources
than many models and let your CPU or GPU run cooler
and require less CPU or GPU power, which means they
cost less to run over time, they are easier on your hardware
and use less electricity over time. Using less electricity
over time means that they will have a lower carbon footprint
on the environment.

# Limitations

MKIA is experimental but it seems to have appropriate uses as mentioned in some of the above material.

# Uses

This model is intended for personal use in a personal assistant or in a companion bot.
It is meant to work with the Little MKIA system that I am developing. Here is a GitHub 
link to the code for a basic bot using the system. 

https://github.com/StevieEngbrock/LittleMKIA/blob/main/microMKIA.py

As I mentioned in some of the above information
the bot can be modified with custom commands and can be further fine-tuned however you want.