Comments on: I’d hammer in the morning http://williamtozier.com/slurry/2005/09/23/id-hammer-in-the-morning Pontification without all the gritty gravitas Fri, 25 Jul 2008 08:13:26 +0000 http://wordpress.org/?v=2.5.1 By: dsquared http://williamtozier.com/slurry/2005/09/23/id-hammer-in-the-morning#comment-101 dsquared Sat, 01 Oct 2005 15:12:39 +0000 http://williamtozier.com/slurry/?p=87#comment-101 It's what you do for when mixtures of logistic functions aren't flexible enough, isn't it? You tend to get laughed out of the shop in econometrics when you get to this level of complexity, but that's mainly because we're usually looking for patterns that probably don't exist. It’s what you do for when mixtures of logistic functions aren’t flexible enough, isn’t it? You tend to get laughed out of the shop in econometrics when you get to this level of complexity, but that’s mainly because we’re usually looking for patterns that probably don’t exist.

]]> By: Alexandre Grings http://williamtozier.com/slurry/2005/09/23/id-hammer-in-the-morning#comment-98 Alexandre Grings Wed, 28 Sep 2005 20:04:55 +0000 http://williamtozier.com/slurry/?p=87#comment-98 What the alternatives to do Symbolic Regression? Make a web search for the term. You will see that there is no definition for the term outside GP world. My guess is that the most of people don't even know that such a problem can be solved by a machine. Take a look in http://www.it.lut.fi/mat/EcmiNL/ecmi35/node70.html What the alternatives to do Symbolic Regression?
Make a web search for the term. You will see that there is no definition for the term outside GP world.
My guess is that the most of people don’t even know that such a problem can be solved by a machine.
Take a look in http://www.it.lut.fi/mat/EcmiNL/ecmi35/node70.html

]]> By: Bill http://williamtozier.com/slurry/2005/09/23/id-hammer-in-the-morning#comment-97 Bill Wed, 28 Sep 2005 14:32:50 +0000 http://williamtozier.com/slurry/?p=87#comment-97 This is true... but you can't really make strong statements about the role of, say, qualitative relationship between mass and time variables,as you can with symbolic regression approaches. In many cases, the customer--the person who wants and pays to see the analysis done--may not realize initially that they don't just want a classifier or a model, but also want one that provides insight to drive further first-principles modeling and experimentation. That's the shortcoming of most NN-like and PCA-like approaches: the intermediate calculations are some function of almost all the inputs, and as a result it's nigh impossible to tease out meaningful insight. Anyway... I'm working on it..... This is true… but you can’t really make strong statements about the role of, say, qualitative relationship between mass and time variables,as you can with symbolic regression approaches.

In many cases, the customer–the person who wants and pays to see the analysis done–may not realize initially that they don’t just want a classifier or a model, but also want one that provides insight to drive further first-principles modeling and experimentation. That’s the shortcoming of most NN-like and PCA-like approaches: the intermediate calculations are some function of almost all the inputs, and as a result it’s nigh impossible to tease out meaningful insight.

Anyway… I’m working on it…..

]]> By: aleks http://williamtozier.com/slurry/2005/09/23/id-hammer-in-the-morning#comment-96 aleks Wed, 28 Sep 2005 11:13:55 +0000 http://williamtozier.com/slurry/?p=87#comment-96 Just BTW: One can convert a SVM into the form of a generalized additive model and then show it graphically: http://portal.acm.org/citation.cfm?id=1081870.1081886 The dimensionality of the visualization depends on the kernel. Just BTW: One can convert a SVM into the form of a generalized additive model and then show it graphically: http://portal.acm.org/citation.cfm?id=1081870.1081886 The dimensionality of the visualization depends on the kernel.

]]> By: son1 http://williamtozier.com/slurry/2005/09/23/id-hammer-in-the-morning#comment-80 son1 Fri, 23 Sep 2005 14:21:55 +0000 http://williamtozier.com/slurry/?p=87#comment-80 Just out of curiosity, do you really think that any reasonably complex Bayesian network, whose parameter-set or structure is learned from the data, is likely to be any <i>less</i> opaque than the results of a well-designed SVM? Never-mind the fact that the graph representation of a bayesian network often invites people to consider the edges which are drawn (when in fact, it's what <i>isn't</i> drawn that's important, graphically) and, at the same time, to consider the edges singly (when in fact, it's a "set of edges" which form the incoming arcs to a node that are the irreducible elements in a BN), which is totally wrong. Bleh. (what I'm saying is, it's not about your machine-learning tool-of-choice, it's about the auxiliary tools you have available to summarize and visualize the results of whatever method you've chosen.) But I'm intrigued... what is GP/SR? and how is it different from a genetic algorithm? Just out of curiosity, do you really think that any reasonably complex Bayesian network, whose parameter-set or structure is learned from the data, is likely to be any less opaque than the results of a well-designed SVM?

Never-mind the fact that the graph representation of a bayesian network often invites people to consider the edges which are drawn (when in fact, it’s what isn’t drawn that’s important, graphically) and, at the same time, to consider the edges singly (when in fact, it’s a “set of edges” which form the incoming arcs to a node that are the irreducible elements in a BN), which is totally wrong.

Bleh. (what I’m saying is, it’s not about your machine-learning tool-of-choice, it’s about the auxiliary tools you have available to summarize and visualize the results of whatever method you’ve chosen.)

But I’m intrigued… what is GP/SR? and how is it different from a genetic algorithm?

]]>