![]() You can think of it as taking apart software the way you would take apart a clock or a PC to see its parts and figure out how it operates.Īlso: I used ChatGPT to write the same routine in 12 top programming languages. It's that combinatorial element that gives the program its Hyena name.Ī recent practice in AI science, known as mechanistic interpretability, is yielding insights about what is going on deep inside a neural network, inside the computational "circuits" of attention. In some analogous fashion, the Hyena program applies a bunch of very simple operations, as you'll see, over and over again, so that they combine to form a kind of hierarchy of data processing. In a sense, a very powerful language model could be like a hyena, hunting for miles and miles to find nourishment.īut the authors are really concerned with "hierarchy", as the title suggests, and families of hyenas have a strict hierarchy by which members of a local hyena clan have varying levels of rank that establish dominance. ![]() Hyenas are animals that live in Africa that can hunt for miles and miles. ![]() The authors don't explain the name, but one can imagine several reasons for a "Hyena" program. In the new paper, 'Hyena Hierarchy: Towards Larger Convolutional Language Models', posted on the arXiv pre-print server, lead author Michael Poli of Stanford and his colleagues propose to replace the Transformer's attention function with something sub-quadratic, namely Hyena.Īlso: What is Auto-GPT? Everything to know about the next powerful AI tool That complexity means the amount of time it takes for ChatGPT to produce an answer increases as the square of the amount of data it is fed as input.Īt some point, if there is too much data - too many words in the prompt, or too many strings of conversations over hours and hours of chatting with the program - then either the program gets bogged down providing an answer, or it must be given more and more GPU chips to run faster and faster, leading to a surge in computing requirements. That attention operation - the essential tool of all large language programs, including ChatGPT and GPT-4 - has "quadratic" computational complexity (Wiki " time complexity" of computing). It uses something called "attention," where the computer program takes the information in one group of symbols, such as words, and moves that information to a new group of symbols, such as the answer you see from ChatGPT, which is the output.Īlso: What is GPT-4? Here's everything you need to know Now I'm thinking of how much easier many of my Illustrator drawings would be if I just programmed them in OpenSCAD.But the Transformer has a big flaw. My DDG searches weren't quite coming up with anything besides a few old GitHub issues. I decided to put up this blog post in the hopes it might help someone else doing the same thing. Now it shows up as a 2D plane drawing:Īnd now the 'Export as PDF.' option (as well as the other 2D options like SVG) works great, allowing me to save a to-scale PDF suitable for reference or printing: To get something exportable, I just added projection() at the top of my model to turn the top-down view into a 2D projection, then Rendered the object. If I tried exporting a PDF or SVG of the model (File > Export > Export as PDF.), it understandably didn't know what to do: Some online utilities took an STL file and turned it into a PNG, but they weren't great and most wouldn't output a PNG with the exact dimensions as the model (they printed too big or too small). The idea was to print a to-scale line drawing of the part on my laser printer, cut it out, fold it, and check to make sure everything lined up correctly. ![]() Before 3D printing the final design, or cutting metal, I wanted to 'dry fit' my design to make sure my measurements were correct. One thing I wanted to do recently was model a sheet-metal object that would be cut from a flat piece of sheet metal, then folded into its final form using a brake. I've been getting into OpenSCAD lately-I'd rather wrestle with a text-based 3D modeling application for more dimensional models than fight with lockups of Fusion 360!
0 Comments
Leave a Reply. |