Author Topic: Blaise Aguera doing a pretty good 101 in neural nets  (Read 5566 times)

P3nT4gR4m

  • Official SSOOKN Pariah
  • Deserved It
  • ****
  • Posts: 72167
  • I'm an artist now - isn't that depressing?
    • View Profile
    • fuck you
Blaise Aguera doing a pretty good 101 in neural nets
« on: June 30, 2016, 06:31:41 pm »
http://www.ted.com/talks/blaise_aguera_y_arcas_how_computers_are_learning_to_be_creative#t-539223

So I watched a couple of youtube clips a while back, that explained what learning algorithms are up to well enough for my brain to take in but, for anyone who's still trying to wrap their heads around it, the first half of this ted talk does a pretty good job of summing it up.
Not actually a meat product.
Ass-Kicking & Foot-Stomping Ancient Master of SHIT FUCK FUCK FUCK
Awful and Bent Behemothic Results of Last Night's Painful Squat.
High Altitude Haggis-Filled Sex Bucket From Beyond Time and Space.
Internet Monkey Person of Filthy and Immoral Pygmy-Porn Wart Contagion
Octomom Auxillary Heat Exchanger Repairman
walking the fine line line between genius and batshit fucking crazy

"computation is a pattern in the spacetime arrangement of particles, and it’s not the particles but the pattern that really matters! Matter doesn’t matter." -- Max Tegmark

LuciferX

  • Metanoia
  • Deserved It
  • ****
  • Posts: 28062
  • fripping moncrey!
    • View Profile
Re: Blaise Aguera doing a pretty good 101 in neural nets
« Reply #1 on: July 03, 2016, 08:29:38 pm »
http://www.ted.com/talks/blaise_aguera_y_arcas_how_computers_are_learning_to_be_creative#t-539223

So I watched a couple of youtube clips a while back, that explained what learning algorithms are up to well enough for my brain to take in but, for anyone who's still trying to wrap their heads around it, the first half of this ted talk does a pretty good job of summing it up.

Yea.  I liked this one.

W.X = y
W.X - y = 0

Very simple, though not always entirely obvious.
Hic Salta?
________
Constant Eso-Opthamologist of Elicited Stopped-Clock Illusions, brings it back, or sinners just repent______

Brother Mythos

  • Outlandish
  • ***
  • Posts: 9253
    • View Profile
Re: Blaise Aguera doing a pretty good 101 in neural nets
« Reply #2 on: July 06, 2016, 11:52:20 am »
http://www.ted.com/talks/blaise_aguera_y_arcas_how_computers_are_learning_to_be_creative#t-539223

So I watched a couple of youtube clips a while back, that explained what learning algorithms are up to well enough for my brain to take in but, for anyone who's still trying to wrap their heads around it, the first half of this ted talk does a pretty good job of summing it up.

As I’m starting out with zero (0) knowledge of artificial neural networks, I think it’s going to take just a little bit more to get me up to 101 level.

Nevertheless, I found the video clip interesting enough to want to learn more about the subject. So, I’m starting with the ‘Artificial neural network’ article on ‘Wikipedia’, and I’ll see where that leads me.

P3nT4gR4m

  • Official SSOOKN Pariah
  • Deserved It
  • ****
  • Posts: 72167
  • I'm an artist now - isn't that depressing?
    • View Profile
    • fuck you
Re: Blaise Aguera doing a pretty good 101 in neural nets
« Reply #3 on: July 06, 2016, 06:16:29 pm »
These 3 vids are the ones that I found the most useful in helping me grasp the concept. I was coming at it from a programmers point of view - "How do I code it" Turns out that was the wrong question. You don't code it, it just works.

CNN's are only part of the picture but they're a good starting point. Now I I can grok them, a lot of the other stuff makes more sense.

https://youtu.be/l42lr8AlrHk

https://youtu.be/C_zFhWdM4ic

https://www.youtube.com/watch?v=py5byOOHZM8
Not actually a meat product.
Ass-Kicking & Foot-Stomping Ancient Master of SHIT FUCK FUCK FUCK
Awful and Bent Behemothic Results of Last Night's Painful Squat.
High Altitude Haggis-Filled Sex Bucket From Beyond Time and Space.
Internet Monkey Person of Filthy and Immoral Pygmy-Porn Wart Contagion
Octomom Auxillary Heat Exchanger Repairman
walking the fine line line between genius and batshit fucking crazy

"computation is a pattern in the spacetime arrangement of particles, and it’s not the particles but the pattern that really matters! Matter doesn’t matter." -- Max Tegmark

Brother Mythos

  • Outlandish
  • ***
  • Posts: 9253
    • View Profile
Re: Blaise Aguera doing a pretty good 101 in neural nets
« Reply #4 on: July 07, 2016, 02:12:04 am »
These 3 vids are the ones that I found the most useful in helping me grasp the concept. I was coming at it from a programmers point of view - "How do I code it" Turns out that was the wrong question. You don't code it, it just works.

CNN's are only part of the picture but they're a good starting point. Now I I can grok them, a lot of the other stuff makes more sense.

https://youtu.be/l42lr8AlrHk

https://youtu.be/C_zFhWdM4ic

https://www.youtube.com/watch?v=py5byOOHZM8

Thanks for the additional links. I’ll check them out and see if I can wrap my head around this subject.

P3nT4gR4m

  • Official SSOOKN Pariah
  • Deserved It
  • ****
  • Posts: 72167
  • I'm an artist now - isn't that depressing?
    • View Profile
    • fuck you
Re: Blaise Aguera doing a pretty good 101 in neural nets
« Reply #5 on: July 07, 2016, 09:01:59 am »
Reminds me a bit of when I learned oop - months of people talking complete gobbledygook and then suddenly I just saw it.  :lulz:
Not actually a meat product.
Ass-Kicking & Foot-Stomping Ancient Master of SHIT FUCK FUCK FUCK
Awful and Bent Behemothic Results of Last Night's Painful Squat.
High Altitude Haggis-Filled Sex Bucket From Beyond Time and Space.
Internet Monkey Person of Filthy and Immoral Pygmy-Porn Wart Contagion
Octomom Auxillary Heat Exchanger Repairman
walking the fine line line between genius and batshit fucking crazy

"computation is a pattern in the spacetime arrangement of particles, and it’s not the particles but the pattern that really matters! Matter doesn’t matter." -- Max Tegmark

Mesozoic Mister Nigel

  • v=1/3πr2h
  • Deserved It
  • ****
  • Posts: 687093
  • The sky tastes like red exuberance.
    • View Profile
Re: Blaise Aguera doing a pretty good 101 in neural nets
« Reply #6 on: July 07, 2016, 09:21:19 pm »
Slightly different topic, but related and I thought this might be of interest to you: https://www.coursera.org/learn/computational-neurosciencecompneuro
“I’m guessing it was January 2007, a meeting in Bethesda, we got a bag of bees and just started smashing them on the desk,” Charles Wick said. “It was very complicated.”


P3nT4gR4m

  • Official SSOOKN Pariah
  • Deserved It
  • ****
  • Posts: 72167
  • I'm an artist now - isn't that depressing?
    • View Profile
    • fuck you
Re: Blaise Aguera doing a pretty good 101 in neural nets
« Reply #7 on: July 08, 2016, 08:06:31 am »
Cheers, Nigel. I keep hearing about computational neuroscience but I get the impression it's more biology than computer science?

Machine learning and related AI stuff seems to pick up any interesting mathematical results neuroscience spits out and figures out if they can be used in ML models. The keyword is "inspired by". I'm just about at the point now where I'm ready to start arsing about with these models. In hacker terminology "hello world". Compile a program that prints your name on the screen. The science part I'm happy to leave to the scientists ;)

First I need to pick an api from the seven billion available.  :eek:
Not actually a meat product.
Ass-Kicking & Foot-Stomping Ancient Master of SHIT FUCK FUCK FUCK
Awful and Bent Behemothic Results of Last Night's Painful Squat.
High Altitude Haggis-Filled Sex Bucket From Beyond Time and Space.
Internet Monkey Person of Filthy and Immoral Pygmy-Porn Wart Contagion
Octomom Auxillary Heat Exchanger Repairman
walking the fine line line between genius and batshit fucking crazy

"computation is a pattern in the spacetime arrangement of particles, and it’s not the particles but the pattern that really matters! Matter doesn’t matter." -- Max Tegmark

Mesozoic Mister Nigel

  • v=1/3πr2h
  • Deserved It
  • ****
  • Posts: 687093
  • The sky tastes like red exuberance.
    • View Profile
Re: Blaise Aguera doing a pretty good 101 in neural nets
« Reply #8 on: July 09, 2016, 08:09:05 pm »
Cheers, Nigel. I keep hearing about computational neuroscience but I get the impression it's more biology than computer science?

Machine learning and related AI stuff seems to pick up any interesting mathematical results neuroscience spits out and figures out if they can be used in ML models. The keyword is "inspired by". I'm just about at the point now where I'm ready to start arsing about with these models. In hacker terminology "hello world". Compile a program that prints your name on the screen. The science part I'm happy to leave to the scientists ;)

First I need to pick an api from the seven billion available.  :eek:

I personally don't consider it biology, but more a crossover between biology and data systems; basically applied systems science. It is essentially neural modeling using computers, to the degree that current computer technology is capable of mimicking biological neural networks. The reason it might be interesting to you or to some of the other folks here is because if you have a baseline understanding of how computational neuroscience works, it can help give you a bigger-picture understanding of what the programmer's version of neural networks is meant to do. You don't have to have a biology background to learn computational neuroscience fundamentals; a lot of people actually come to it via computer science or systems science. I am into wet lab work so it's not so much my bag, but it seems like it could be interesting and/or useful to more tech-minded, computer-oriented people.
“I’m guessing it was January 2007, a meeting in Bethesda, we got a bag of bees and just started smashing them on the desk,” Charles Wick said. “It was very complicated.”


Mesozoic Mister Nigel

  • v=1/3πr2h
  • Deserved It
  • ****
  • Posts: 687093
  • The sky tastes like red exuberance.
    • View Profile
Re: Blaise Aguera doing a pretty good 101 in neural nets
« Reply #9 on: July 09, 2016, 08:18:40 pm »
The MIT course page gives this relatively concise description:

Quote
This course gives a mathematical introduction to neural coding and dynamics. Topics include convolution, correlation, linear systems, game theory, signal detection theory, probability theory, information theory, and reinforcement learning. Applications to neural coding, focusing on the visual system are covered, as well as Hodgkin-Huxley and other related models of neural excitability, stochastic models of ion channels, cable theory, and models of synaptic transmission.
“I’m guessing it was January 2007, a meeting in Bethesda, we got a bag of bees and just started smashing them on the desk,” Charles Wick said. “It was very complicated.”


P3nT4gR4m

  • Official SSOOKN Pariah
  • Deserved It
  • ****
  • Posts: 72167
  • I'm an artist now - isn't that depressing?
    • View Profile
    • fuck you
Re: Blaise Aguera doing a pretty good 101 in neural nets
« Reply #10 on: July 09, 2016, 10:51:18 pm »
Yeah, cool. Its the thing I thought it was. A lot of the ai gurus have backgrounds in "neuroscience" I'm guessing the computational flavour would be like a bridge. I look across it and I see icky, gooey stuff, waiting to pounce on me and I'll place a bet a biology person would look across to this side and see weird mechanical stuff made of robots and numbers.

I heard about some results where simulated results on visual cortex matched the real meat version in some measurable way. That slicing thing you were doing? But I know those meat models are heavy fucking duty compute power, a long way off from use case in any sort of production scenario. The coding equivalent is more high level logic function. What you lack in fidelity, you gain in footprint and scalability.

Intelligence itself is beginning to be clearly understood and described in math. What we're discovering is it can be improved, in machines. Massively. Not personality or intellect,  those are fucked up weird shit that nobody seems to be able to work out yet but raw intelligence. They're calling it "artificial" but really it's more a case of "optimised",  or "ampliified" 

I'm doing what I've been doing since I was a kid - looking for problems and applying computatiinal solutions, only this time I don't need to program it. This will be like cheating for a living.  :lulz:
Not actually a meat product.
Ass-Kicking & Foot-Stomping Ancient Master of SHIT FUCK FUCK FUCK
Awful and Bent Behemothic Results of Last Night's Painful Squat.
High Altitude Haggis-Filled Sex Bucket From Beyond Time and Space.
Internet Monkey Person of Filthy and Immoral Pygmy-Porn Wart Contagion
Octomom Auxillary Heat Exchanger Repairman
walking the fine line line between genius and batshit fucking crazy

"computation is a pattern in the spacetime arrangement of particles, and it’s not the particles but the pattern that really matters! Matter doesn’t matter." -- Max Tegmark

Mesozoic Mister Nigel

  • v=1/3πr2h
  • Deserved It
  • ****
  • Posts: 687093
  • The sky tastes like red exuberance.
    • View Profile
Re: Blaise Aguera doing a pretty good 101 in neural nets
« Reply #11 on: July 09, 2016, 11:54:09 pm »
As a biology person with a pretty solid math and systems science background, mostly what I see are experimental models that seek to approximate the information networks present at all levels of biology; cell signaling and so on. I find it interesting that nobody seems to be trying to mimic signaling cascades, yet, but maybe they are and just haven't published yet.

As a neuroscientist I have to disagree with the perception that anyone is doing mathematical modeling of cognitive intelligence, yet; intelligence as an economist defines it, yes, but economists are worlds away from actual cognition. I suppose it all comes down to how we define intelligence; from a neuroscience perspective, it is typically defined as a combination of learning, memory, and cognition, rather than as simple logic pathways.
“I’m guessing it was January 2007, a meeting in Bethesda, we got a bag of bees and just started smashing them on the desk,” Charles Wick said. “It was very complicated.”


P3nT4gR4m

  • Official SSOOKN Pariah
  • Deserved It
  • ****
  • Posts: 72167
  • I'm an artist now - isn't that depressing?
    • View Profile
    • fuck you
Re: Blaise Aguera doing a pretty good 101 in neural nets
« Reply #12 on: July 10, 2016, 12:23:48 am »
One of those cross discipline,  same terminology deals? Intelligence in the ai vernacular is like a black box version of software but much more powerful. We understand why it works but the actual state,  in old money the program logic, is something that just happens. It learns. It learns to perform intelligent operations on input data. It does stuff that would take millions of coders millions of years to hand code. If it could even be hand coded at all.

Considering the impact the olde fashioned, hand coded shit just had on the planet, I'm fast approaching certainty that no one aint seen nothing yet.
Not actually a meat product.
Ass-Kicking & Foot-Stomping Ancient Master of SHIT FUCK FUCK FUCK
Awful and Bent Behemothic Results of Last Night's Painful Squat.
High Altitude Haggis-Filled Sex Bucket From Beyond Time and Space.
Internet Monkey Person of Filthy and Immoral Pygmy-Porn Wart Contagion
Octomom Auxillary Heat Exchanger Repairman
walking the fine line line between genius and batshit fucking crazy

"computation is a pattern in the spacetime arrangement of particles, and it’s not the particles but the pattern that really matters! Matter doesn’t matter." -- Max Tegmark

Freeky

  • Can't breathe anymore.
  • Deserved It
  • ****
  • Posts: 187801
  • wat
    • View Profile
Re: Blaise Aguera doing a pretty good 101 in neural nets
« Reply #13 on: July 10, 2016, 01:34:23 am »
As a neuroscientist I have to disagree with the perception that anyone is doing mathematical modeling of cognitive intelligence, yet; intelligence as an economist defines it, yes, but economists are worlds away from actual cognition.
:lol:
I'm putting this in my sig.
If someone does the “Fine, you’re right, I’m clearly a terrible person, I’m Satan, I’m the worst person alive, I should just die” thing in response to criticism of their harmful behavior, they are trying to manipulate people and flip the situation around so that they look like a victim.

As a neuroscientist I have to disagree with the perception that anyone is doing mathematical modeling of cognitive intelligence, yet; intelligence as an economist defines it, yes, but economists are worlds away from actual cognition.


Although it is outside the purview of this organization to offer personal advice, we can say -- without assuming any liability -- that previous experience indicates (and recent market studies corroborate) that given the present condition of the marketplace, continuing with your present course of action is likely to result in substantial in

Mesozoic Mister Nigel

  • v=1/3πr2h
  • Deserved It
  • ****
  • Posts: 687093
  • The sky tastes like red exuberance.
    • View Profile
Re: Blaise Aguera doing a pretty good 101 in neural nets
« Reply #14 on: July 10, 2016, 01:44:21 am »
One of those cross discipline,  same terminology deals? Intelligence in the ai vernacular is like a black box version of software but much more powerful. We understand why it works but the actual state,  in old money the program logic, is something that just happens. It learns. It learns to perform intelligent operations on input data. It does stuff that would take millions of coders millions of years to hand code. If it could even be hand coded at all.

Considering the impact the olde fashioned, hand coded shit just had on the planet, I'm fast approaching certainty that no one aint seen nothing yet.

Yeah, I know dude. I don't talk about it much but I have a CIS background, and we covered AI and naive intelligence ad nauseum in upper-division neuroscience classes.
“I’m guessing it was January 2007, a meeting in Bethesda, we got a bag of bees and just started smashing them on the desk,” Charles Wick said. “It was very complicated.”