Skip to content
Sudonix

using exclusive nodebb forum data to create a chatgpt chatbot?

Discussion
7 2 2.0k 1
  • crazycellsundefined

    It appears that we are entering a new age… I guess soon we will be wearing glasses that can listen us and analyze statements/commands and make reservations, create alarms, send messages etc.

    With the GPT-4 Turbo (more powerful, faster, and most importantly cheaper), assistants (plug-ins), and a GPT store (specialized gpt versions created by users)…

    I wonder if there’s a potential to leverage NodeBB forum data to train GPT-4 Turbo in a way to create a chatbot, and when users write a question, this bot will give a concise information/answer to users and guiding them directly to relevant topic(s) in the forum by sharing the topic links?

    0
  • crazycellsundefined crazycells

    It appears that we are entering a new age… I guess soon we will be wearing glasses that can listen us and analyze statements/commands and make reservations, create alarms, send messages etc.

    With the GPT-4 Turbo (more powerful, faster, and most importantly cheaper), assistants (plug-ins), and a GPT store (specialized gpt versions created by users)…

    I wonder if there’s a potential to leverage NodeBB forum data to train GPT-4 Turbo in a way to create a chatbot, and when users write a question, this bot will give a concise information/answer to users and guiding them directly to relevant topic(s) in the forum by sharing the topic links?

    phenomlabundefined

    @crazycells Interesting concept, and certainly one that warrants further exploration as it could extend the reach of any forum well beyond what search engines can offer.

    I know that someone in the NodeBB community has already begun something along these lines in the form of ChatGPT moderation, which looks good but isn’t free in the sense that it needs “credits” to work

    https://community.nodebb.org/topic/17198/chatgpt-moderation?_=1699722431266

    From recollection, a pro subscription to GPT4 costs $20/month - and is has caps, such as 50 queries max per 4 hours, and many are questioning if this fee make the product worth it or not - it’s not something I’d specifically use in terms of a subscription per month - at least, not enough to warrant it’s cost.

    For the training part, I guess that ChatGPT would have to crawl your website rather like an indexing service does. However, we already have search capabilities in NodeBB and ChatGPT would effectively be another - the question here is do we really need it?

    Mark – Founder, Phenomlab Ltd
    Executive IT & Security Leadership
    Phenomlab Ltd

    1
  • phenomlabundefined phenomlab

    @crazycells Interesting concept, and certainly one that warrants further exploration as it could extend the reach of any forum well beyond what search engines can offer.

    I know that someone in the NodeBB community has already begun something along these lines in the form of ChatGPT moderation, which looks good but isn’t free in the sense that it needs “credits” to work

    https://community.nodebb.org/topic/17198/chatgpt-moderation?_=1699722431266

    From recollection, a pro subscription to GPT4 costs $20/month - and is has caps, such as 50 queries max per 4 hours, and many are questioning if this fee make the product worth it or not - it’s not something I’d specifically use in terms of a subscription per month - at least, not enough to warrant it’s cost.

    For the training part, I guess that ChatGPT would have to crawl your website rather like an indexing service does. However, we already have search capabilities in NodeBB and ChatGPT would effectively be another - the question here is do we really need it?

    crazycellsundefined

    @phenomlab said in using exclusive nodebb forum data to create a chatgpt chatbot?:

    From recollection, a pro subscription to GPT4 costs $20/month - and is has caps, such as 50 queries max per 4 hours, and many are questioning if this fee make the product worth it or not - it’s not something I’d specifically use in terms of a subscription per month - at least, not enough to warrant it’s cost.

    Maybe I am mistaken, but I thought this is the price for web-based ChatGPT subscription, where you use it for your own questions, right?

    I thought API price is based on the usage? input tokens & output tokens…

    https://help.openai.com/en/articles/7127956-how-much-does-gpt-4-cost

    0
  • crazycellsundefined crazycells

    @phenomlab said in using exclusive nodebb forum data to create a chatgpt chatbot?:

    From recollection, a pro subscription to GPT4 costs $20/month - and is has caps, such as 50 queries max per 4 hours, and many are questioning if this fee make the product worth it or not - it’s not something I’d specifically use in terms of a subscription per month - at least, not enough to warrant it’s cost.

    Maybe I am mistaken, but I thought this is the price for web-based ChatGPT subscription, where you use it for your own questions, right?

    I thought API price is based on the usage? input tokens & output tokens…

    https://help.openai.com/en/articles/7127956-how-much-does-gpt-4-cost

    phenomlabundefined

    @crazycells said in using exclusive nodebb forum data to create a chatgpt chatbot?:

    where you use it for your own questions, right?

    Yes, that’s right. Sorry - I was trying to draw some parallel in terms of the cost.

    @crazycells said in using exclusive nodebb forum data to create a chatgpt chatbot?:

    I thought API price is based on the usage? input tokens & output tokens…

    Yes, it is, although on larger forums it could still land up being quite expensive depending on how often it is used.

    Mark – Founder, Phenomlab Ltd
    Executive IT & Security Leadership
    Phenomlab Ltd

    1
  • phenomlabundefined phenomlab

    @crazycells said in using exclusive nodebb forum data to create a chatgpt chatbot?:

    where you use it for your own questions, right?

    Yes, that’s right. Sorry - I was trying to draw some parallel in terms of the cost.

    @crazycells said in using exclusive nodebb forum data to create a chatgpt chatbot?:

    I thought API price is based on the usage? input tokens & output tokens…

    Yes, it is, although on larger forums it could still land up being quite expensive depending on how often it is used.

    crazycellsundefined

    @phenomlab yes, you are right. But my assumption is that larger forums would have money to fund this, although it does not necessarily have to be the case. This is the rate for GPT-Turbo…

    Screen Shot 2023-11-11 at 18.32.43.png

    $1 for 100.000 input tokens
    $3 for 100.000 output tokens

    1
  • crazycellsundefined crazycells

    @phenomlab yes, you are right. But my assumption is that larger forums would have money to fund this, although it does not necessarily have to be the case. This is the rate for GPT-Turbo…

    Screen Shot 2023-11-11 at 18.32.43.png

    $1 for 100.000 input tokens
    $3 for 100.000 output tokens

    phenomlabundefined

    @crazycells your figures don’t seem to match the video?

    Don’t you mean $1 for 1,000? 🤔

    Mark – Founder, Phenomlab Ltd
    Executive IT & Security Leadership
    Phenomlab Ltd

    0
  • phenomlabundefined phenomlab

    @crazycells your figures don’t seem to match the video?

    Don’t you mean $1 for 1,000? 🤔

    crazycellsundefined

    @phenomlab oh no, that is 1 cent on the video, but you are right, symbols are similar… I just converted it to $1 , since it is more intuitive in daily life…

    1
Log in to reply

Related Topics
  • phenomlabundefined

    Which email client do you use?

    Discussion email client
    56
    22 Votes
    56 Posts
    16k Views
    DownPWundefined
    @phenomlab said in Which email client do you use?: @DownPW Isn’t this more of an email server in it’s own right rather than an email client? Oh yes sorry… I didn’t pay attention
  • Pandaundefined

    Nodebb design

    Solved General nodebb
    2
    1 Votes
    2 Posts
    951 Views
    phenomlabundefined
    @Panda said in Nodebb design: One negative is not being so good for SEO as more Server side rendered forums, if web crawlers dont run the JS to read the forum. From recollection, Google and Bing have the capability to read and process JS, although it’s not in the same manner as a physical person will consume content on a page. It will be seen as plain text, but will be indexed. However, it’s important to note that Yandex and Baidu will not render JS, although seeing as Google has a 90% share of the content available on the web in terms of indexing, this isn’t something you’ll likely lose sleep over. @Panda said in Nodebb design: The “write api” is preferred for server-to-server interactions. This is mostly based around overall security - you won’t typically want a client machine changing database elements or altering data. This is why you have “client-side” which could be DOM manipulation etc, and “server-side” which performs more complex operations as it can communicate directly with the database whereas the client cannot (and if it can, then you have a serious security flaw). Reading from the API is perfectly acceptable on the client-side, but not being able to write. A paradigm here would be something like SNMP. This protocol exists as a UDP (UDP is very efficient, as it is “fire and forget” and does not wait for a response like TCP does) based service which reads performance data from a remote source, thus enabling an application to parse that data for use in a monitoring application. In all cases, SNMP access should be “RO” (Read Only) and not RW (Read Write). It is completely feasible to assume complete control over a firewall for example by having RW access to SNMP and then exposing it to the entire internet with a weak passphrase. You wouldn’t do it (at least, I hope you wouldn’t) and the same ethic applies to server-side rendering and the execution of commands.
  • phenomlabundefined

    Lawyers use of ChatGPT backfires

    Discussion chatgpt
    10
    9 Votes
    10 Posts
    2k Views
    phenomlabundefined
    @crazycells yes, I think it certainly has a place - but to enrich knowledge, rather than simply substitute it. I remember years ago when I did my exams. You weren’t allowed a calculator or anything like that and had to show your workings on a separate piece of paper which you were given additional marks for. These days, they use iPads etc in schools, so the art of writing a letter or needing to perform mathematical calculations in your head is gone. One of my very first jobs was in a newsagent who had a really old till (yes, not a Point-Of-Service like you have today) - all this till did was add up the individual figures, but didn’t tell you how much change to give - you had to do that part. Sounds simple enough, but with technology doing everything for us these days, our basic skills (think the “Three R’s”, and see example below) have taken a back seat and I think that’s made us lazy. https://www.merriam-webster.com/dictionary/three R's Again, my point here being to enrich - not completely replace basic skills we learn as we age.
  • Pandaundefined

    Composer Zen icon?

    Solved Configure nodebb
    8
    1
    2 Votes
    8 Posts
    1k Views
    phenomlabundefined
    @DownPW exactly. Not really a new concept, and in all honesty, not something I’ve ever used. If you consider the need to add links and references, or citations, you’d need to be able to see other parts of the screen!
  • phenomlabundefined

    TikTok fined £12.7m for misusing children's data

    Discussion tiktok privacy security
    4
    4 Votes
    4 Posts
    1k Views
    JACundefined
    @phenomlab said in TikTok fined £12.7m for misusing children’s data: Just another reason not to use TikTok. Zero privacy, Zero respect for privacy, and Zero controls in place. https://news.sky.com/story/tiktok-fined-12-7m-for-data-protection-breaches-12849702 The quote from this article says it all TikTok should have known better. TikTok should have done better They should have, but didn’t. Clearly the same distinct lack of core values as Facebook. Profit first, privacy… well, maybe. Wow, that’s crazy! so glad I stayed away from it, rotten to the core.
  • cagatayundefined

    NodeBB v3

    Announcements nodebb v3 nodebb
    2
    3 Votes
    2 Posts
    902 Views
    phenomlabundefined
    @cagatay JS will work fine - no changes there, and there are no plans to drop support for jQuery. More of an issue is the CSS - for which there are quite a few breaking changes. Keep an eye on sudonix.dev (my development site) where you can see progress in relation to how I am tackling the compatibility issues.
  • DownPWundefined

    NodeBB 1.19.3

    Solved Performance nodebb 1.19.3 performance
    33
    4 Votes
    33 Posts
    11k Views
    DownPWundefined
    @phenomlab I find the problem Mark The error message indicated this path : http://localhost:4567/assets/plugins/nodebb-plugin-emoji/emoji/styles.css?v=6983dobg16u I change the path url on config.json [image: 1645128773854-47bacc80-f141-41e4-a261-3f8d650cc6f6-image.png] And all it’s good Weird, I didn’t have to change that path before 1.19.3 But this does not prevent the problem from a clean install with Emoji Plugin EDIT: After test, that resolv the problem installation for 1.18.x but not for 1.19.x (I have other error message when I run ./nodebb Setup For resume: NodeJS 16_x with 1.18.x is ok
  • crazycellsundefined

    [NodeBB] username cards

    Solved Customisation nodebb
    8
    5 Votes
    8 Posts
    2k Views
    Sampo2910undefined
    @phenomlab Aha…nice to know. As always thank you for the reply and information.