Items of some interest…

These are my recent Pinboard.in links:

Items of some interest…

These are my recent Pinboard.in links:

  • [1101.4003] Dyna-H: a heuristic planning reinforcement learning algorithm applied to role-playing-game strategy decision systems

    "In a Role-Playing Game, finding optimal trajectories is one of the most important tasks. In fact, the strategy decision system becomes a key component of a game engine. Determining the way in which decisions are taken (online, batch or simulated) and the consumed resources in decision making (e.g. execution time, memory) will influence, in mayor degree, the game performance. When classical search algorithms such as A* can be used, they are the very first option. Nevertheless, such methods rely on precise and complete models of the search space, and there are many interesting scenarios where their application is not possible. Then, model free methods for sequential decision making under uncertainty are the best choice. In this paper, we propose a heuristic planning strategy to incorporate the ability of heuristic-search in path-finding into a Dyna agent. The proposed Dyna-H algorithm, as A* does, selects branches more likely to produce outcomes than other branches. Besides, it has the advantages of being a model-free online reinforcement learning algorithm. The proposal was evaluated against the one-step Q-Learning and Dyna-Q algorithms obtaining excellent experimental results: Dyna-H significantly overcomes both methods in all experiments. We suggest also, a functional analogy between the proposed sampling from worst trajectories heuristic and the role of dreams (e.g. nightmares) in human behavior."

    planning machine-learning nudge-targets easy-pickins

  • [0908.3565] Distributed Location Optimization for Sensors with Limited Range Heterogeneous Capabilities using Generalized Voronoi Partition

    "In this paper a generalization of the Voronoi partition is used for solving a heterogeneous distributed locational optimization problem for autonomous agents, such as AGVs, UAVs, etc. The problem addressed is of optimal deployment of agents equipped with sensors, having heterogeneous capabilities, and limited range, to maximize sensor coverage. An objective function for optimal deployment of agents is formulated, and its critical points are determined. The optimal deployment is shown to be the generalized centroidal Voronoi configuration in which the agents are located at the centroids of the corresponding generalized Voronoi cells. Formal results on stability, convergence, and on spatial distribution of the proposed control laws responsible for agent motion, under some constraints on the agents' speeds and limit on sensor range are provided. The theoretical results are supported with illustrative simulation"

    agent-based coordination sensor-networks nudge-targets emergent-design

  • [1106.6058] Stability of strategies in payoff-driven evolutionary games on networks

    "We consider a network of coupled agents playing the Prisoner's Dilemma game, in which players are allowed to pick a strategy in the interval [0,1], with 0 corresponding to defection, 1 to cooperation, and intermediate values representing mixed strategies in which each player may act as a cooperator or a defector over a large number of interactions with a certain probability. Our model is payoff-driven, i.e., we assume that the level of accumulated payoff at each node is a relevant parameter in the selection of strategies. Also, we consider that each player chooses his/her strategy in a context of limited information. We present a deterministic nonlinear model for the evolution of strategies. We show that the final strategies depend on the network structure and on the choice of the parameters of the game. We find that polarized strategies (pure cooperator/defector states) typically emerge when (i) the network connections are sparse, (ii) the network degree distribution is heterogeneous, (iii) the network is assortative, and surprisingly, (iv) the benefit of cooperation is high."

    prisoners'-dilemma agent-based network-theory artificial-life complexology nudge-targets

  • [1106.0296] The Emergence of Leadership in Social Networks

    "We study a networked version of the minority game in which agents can choose to follow the choices made by a neighbouring agent in a social network. We show that for a wide variety of networks a leadership structure always emerges, with most agents following the choice made by a few agents. We find a suitable parameterisation which highlights the universal aspects of the behaviour and which also indicates where results depend on the type of social network."

    minority-game social-networks sociology agent-based network-theory

  • [1106.1816] Monitoring Teams by Overhearing: A Multi-Agent Plan-Recognition Approach

    "Recent years are seeing an increasing need for on-line monitoring of teams of cooperating agents, e.g., for visualization, or performance tracking. However, in monitoring deployed teams, we often cannot rely on the agents to always communicate their state to the monitoring system. This paper presents a non-intrusive approach to monitoring by 'overhearing', where the monitored team's state is inferred (via plan-recognition) from team-members' routine communications, exchanged as part of their coordinated task execution, and observed (overheard) by the monitoring system. Key challenges in this approach include the demanding run-time requirements of monitoring, the scarceness of observations (increasing monitoring uncertainty), and the need to scale-up monitoring to address potentially large teams. To address these, we present a set of complementary novel techniques, exploiting knowledge of the social structures and procedures in the monitored team: (i) an efficient probabilistic plan-recognition algorithm, well-suited for processing communications as observations; (ii) an approach to exploiting knowledge of the team's social behavior to predict future observations during execution (reducing monitoring uncertainty); and (iii) monitoring algorithms that trade expressivity for scalability, representing only certain useful monitoring hypotheses, but allowing for any number of agents and their different activities to be represented in a single coherent entity. We present an empirical evaluation of these techniques, in combination and apart, in monitoring a deployed team of agents, running on machines physically distributed across the country, and engaged in complex, dynamic task execution. We also compare the performance of these techniques to human expert and novice monitors, and show that the techniques presented are capable of monitoring at human-expert levels, despite the difficulty of the task."

    emergent-design agent-based swarms coordination nudge

  • [1011.2861] A Comprehensive Workflow for General-Purpose Neural Modeling with Highly Configurable Neuromorphic Hardware Systems

    "In this paper we present a methodological framework that meets novel requirements emerging from upcoming types of accelerated and highly configurable neuromorphic hardware systems. We describe in detail a device with 45 million programmable and dynamic synapses that is currently under development, and we sketch the conceptual challenges that arise from taking this platform into operation. More specifically, we aim at the establishment of this neuromorphic system as a flexible and neuroscientifically valuable modeling tool that can be used by non-hardware-experts. We consider various functional aspects to be crucial for this purpose, and we introduce a consistent workflow with detailed descriptions of all involved modules that implement the suggested steps: The integration of the hardware interface into the simulator-independent model description language PyNN; a fully automated translation between the PyNN domain and appropriate hardware configurations; an executable specification of the future neuromorphic system that can be seamlessly integrated into this biology-to-hardware mapping process as a test bench for all software layers and possible hardware design modifications; an evaluation scheme that deploys models from a dedicated benchmark library, compares the results generated by virtual or prototype hardware devices with reference software simulations and analyzes the differences. The integration of these components into one hardware-software workflow provides an ecosystem for ongoing preparative studies that support the hardware design process and represents the basis for the maturity of the model-to-hardware mapping software. The functionality and flexibility of the latter is proven with a variety of experimental results."

    neural-networks biologically-inspired electronics emergent-design nudge-targets

Items of some interest…

These are my recent Pinboard.in links:

Items of some interest…

These are my recent Pinboard.in links:

Items of some interest…

These are my recent Pinboard.in links:

  • Local Motors Competition: Terra Prix 2085 – Core77 – "Local Motors, a revolutionary crowd-sourced car company, is holding a concept design competition for a transcontinental race vehicle with a support ship."
  • industrial-design competition Syd-Mead engineering-design awesome

  • Faulty Towers: The Crisis in Higher Education | The Nation – "…For all its pretensions to public importance (every professor secretly thinks he’s a public intellectual), the professoriate is awfully quiet, essentially nonexistent as a collective voice. If academia is going to once again become a decent place to work, if our best young minds are going to be attracted back to the profession, if higher education is going to be reclaimed as part of the American promise, if teaching and research are going to make the country strong again, then professors need to get off their backsides and organize: department by department, institution to institution, state by state and across the nation as a whole. Tenured professors enjoy the strongest speech protections in society. It’s time they started using them."
  • reformation-is-gonna-be-ouchy disintermediation-targets life-o'-the-mind cultural-assumptions education graduate-school academia-doesn't-guarantee-acuity academic-culture

  • Ninth Circuit Court: Secret GPS Tracking is Legal | Executive Gov – 'In the majority opinion, the Ninth Circuit Court ruled that since Pineda-Moreno’s driveway wasn’t enclosed and was open to passersby like delivery men and neighborhood children, it didn’t pass the Dunn test for curtilage.  Never mind that in the Dunn opinion, the majority writes “we do not suggest that combining these factors produces a finely tuned formula that, when mechanically applied, yields a “correct” answer to all extent-of-curtilage questions.”'
  • Bushism freedom search-and-seizure Constitutionality feds lawyers

  • What Bureaucracy Looks Like
  • photography exhibition bureaucracy worklife sociology cultural-norms

  • Taking the plunge | johnaugust.com – "You’ll be told it’s because it makes communicating your vision easier, and that’s true.  But there are two more important reasons.  First, if you know how to be a sound man, you know how to make the sound man’s job easier. This has the potential to make you very popular with sound men (or editors, or cinematographers, etc), something you’ll need when your only currency is good will.  Second, when you begin producing your own work, this renaissance approach to filmmaking will allow you to start before anyone else signs on.  Knowing you can finish in a pinch, if you have to, will lend you a confident relentlessness that makes others want to get involved."
  • generalism learning-by-doing advice

  • James on Habit – "…Keep the faculty of effort alive in you by a little gratuitous exercise every day. That is, be systematically heroic in little unnecessary points, do every day or two something for no other reason than its difficulty, so that, when the hour of dire need draws nigh, it may find you not unnerved and untrained to stand the test."
  • habit psychology sociology William-James advice learning

  • Seth’s Blog: The future of the library – "The next library is a place, still. A place where people come together to do co-working and coordinate and invent projects worth working on together. Aided by a librarian who understands the Mesh, a librarian who can bring domain knowledge and people knowledge and access to information to bear.

    The next library is a house for the librarian with the guts to invite kids in to teach them how to get better grades while doing less grunt work. And to teach them how to use a soldering iron or take apart something with no user servicable parts inside. And even to challenge them to teach classes on their passions, merely because it's fun. This librarian takes responsibility/blame for any kid who manages to graduate from school without being a first-rate data shark.

    The next library is filled with so many web terminals there's always at least one empty. And the people who run this library don't view the combination of access to data and connections to peers as a sidelight–it's the entire point.

    Wouldn't you want to live and work and pay taxes in a town that had a library like that? The vibe of the best Brooklyn coffee shop combined with a passionate raconteur of information? There are one thousands things that could be done in a place like this, all built around one mission: take the world of data, combine it with the people in this community and create value."

  • library2.0 seth-godin libraries communities-of-practice expertise librarians museums-too