Hacker News new | past | comments | ask | show | jobs | submit | more paulsmith's comments login

Deep learning! It's all "just" (more or less) high school calculus (partial derivatives, chain rule) and matrix multiplication.


I feel like I saw one once but lost it -

Is there a githubrepo/tutorial for how linear algebra is used for a very small model just to demonstrate how that allows it to "learn"?

I've got the calc, I just don't understand what the matrix multiplication "does"


Watch Karpathy's recent lectures. They're gold. Start here[1] with micrograd[2]. It doesn't use linear algebra/matrices to start, but the principles are the same. The matrix multiplication is how the weights of the connections between neurons and the input values are combined (to form an activation value that then may lead to that neuron "firing" or not, depending on whether it passes some threshold function). We use matrices to model the connections between neurons - each row is a connection, and each column is a weight corresponding to an input.

[1] https://www.youtube.com/watch?v=VMj-3S1tku0 [2] https://github.com/karpathy/micrograd


I cannot recommend Andrew Ng's courses on Machine Learning enough. Something like this seems like it would cover everything you're looking for.

https://www.coursera.org/learn/machine-learning

I cannot speak to the author of the content of this github repo, but it appears they have completed the course and included all of the solutions here. It might let you jump right to what you're looking for.

https://github.com/greyhatguy007/Machine-Learning-Specializa...


What math pre-reqs does it need for someone who never made it to college level maths?


Based on my experience as long as you have a good foundation in the basics of algebra you’ll be able to pick up the rest from the course.


Looks like the Go implementation has been pulled out to its own repo and has been recently maintained: https://github.com/network-quality/goserver

Also of note: looks like Apple has proposed a new IETF RFC for responsiveness and the "Round-trips Per Minute" (RPM) metric: https://github.com/network-quality/draft-ietf-ippm-responsiv...


I've always thought those ?v= after YouTube links and ?id= after HN articles looked sus ...


It's how YouTube tracks what videos I watch and how HN tracks what comments I've read! Dastardly clever of them...


Niko if you are reading this please add RSS to your blog!



> Also, what about IDE plugins?

An LSP server for Pushup syntax is on the informal roadmap.


> What does a Treeview look like - in a ".up" file, can I walk a tree (like io.fs.FS) ?

Yes, you can just write normal Go code to traverse a filesystem and do with it whatever you like.

> Can I compile a Pushup app into a giant WASM hairball and run the whole thing in the browser ?

I haven't tried this so I don't know what would happen, and a lot would depend on what kind of JS host runtime support there was for anything that is doing a syscall.

But related to WASM, an idea I have is to add syntax to be able to split a Pushup page into client-side and server-side code, compile the client-side code to WASM, and use the Pushup compiler to generate the appropriate handoffs for any network calls between (AJAX, websocket, etc.)


Ideally then, the client side could run in disconnected mode. But then you encounter DB sync issues. And I wonder what htmx does then.


I came across this during my initial research when starting Pushup, very impressive.


Not yet, but that is the intent. As a long-time Django user I have a high bar for the kind of forms support a framework should provide. One of my thoughts/beliefs is that, as a compiler with complete control over the page, there is a lot Pushup can do on both the markup generation side as well as checks and validations. eg., automatic CSRF token insertion, compiler "warnings" for accessibility, etc.


> why not just mimic JSX

Definitely considered that. Might be worth revisiting.

> The big missing piece to me here is composability

You zeroed in on the right things ;^) I have a draft note to myself about pages-as-components. I have some ideas (basically, mimic ASP.net Razor components at the moment). Having a compiler with full control of the page makes this easier to figure out.

> without having to backtrack, since that last period is ambiguous in this grammar.

It doesn't backtrack, it just looksahead at the next token: https://github.com/adhocteam/pushup/blob/main/main.go#L3692


Yep, or admins or settings apps, for example. Pushup is partly designed to support the "mildly dynamic" site https://www.devever.net/~hl/mildlydynamic


Join us for AI Startup School this June 16-17 in San Francisco!

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: