From the course: Sustainable AI for Developers: Strategies, Techniques, and Best Practices

Unlock the full course today

Join today to access over 24,900 courses taught by industry experts.

When to use and not use GenAI and LLMs

When to use and not use GenAI and LLMs

- Most of the time, picking the right tool for the right purpose will be the best thing you can do to lower your energy consumption. Since LLM are the talk of the town these days, people often try to use them even when it doesn't make sense or when there are better options available. LLMs are a good fit when you are asking the system to deal with complex language tasks, such as building coherent and contextual strings of text, dealing with large amounts of unstructured data, building contextual understanding to provide relevant responses, and creative applications, such as writing poetry, scripts, and more. However, keep in mind that LLMs are known to use a lot of resources because they're trained on billions of parameters. So if you have a constrained environment, then they might not be your best choice. LLMs are not suited for real time or low latency type applications, where a subsequent response to questions is desired. For simpler tasks, such as prediction, there are better…

Contents