Questions tagged [software-evaluation]

Use for objective evaluations and assessments of API, plug-ins, frameworks, etc. (i.e. should not be opinion based for formal answers, but based on structure, architecture, and validated performance.) Opinions may be suitable for comments, but not for formal answers.

The idea here is that these APIs, frameworks, etc. are "known quantities" and therefore can be objectively assessed.

Even in the case of "black box" software, performance can be rated statistically.

Distinct from "Software recommendations", although there may be some overlap.

With so many options, it is useful to get analyses backed up by facts and data.

9 questions
9
votes
1 answer

Why is the status of artificial life software so under-developed?

I'm interested in self replicating artificial life (with many agents), so after reviewing the literature with the excellent Kinematic Self-Replicating Machines I started looking for software implementations. I understand that the field is still in…
3
votes
1 answer

Building 'evaluation' neural networks for go, reversi, checkers etc, how to train?

I'm trying to build neural networks for games like Go, Reversi, Othello, Checkers, or even tic-tac-toe, not by calculating a move, but by making them evaluate a position. The input is any board situation. The output is a score or estimate for the…
2
votes
1 answer

Is there any opensource 2d open-world simulation with python API?

For my pet project I’m looking for a grid-like world simulation with some kind of resources that requires from agent incrementally intelligent behaviour to survive. Something like this steam game, but with API. I’ve seen minecraft fork, but it’s…
Kirill Fedyanin
  • 549
  • 2
  • 13
2
votes
1 answer

How to evaluate a Deep Q-Network

Good day, it's a pleasure having joined this Stack. In my master thesis I have to expand a Deep Reinforcement Learning Network, to be precise a Deep Q-Network, which is used to control machines in an electrical grid for power quality management.…
1
vote
2 answers

How can I evaluate the performance of a system that generates text?

I am preparing to perform research comparing the performance of two different systems that probabilistically generate the next word of an input sentence. For example, given the word 'the', a system might output 'car', or any other word. Given the…
1
vote
2 answers

Classifying non-labeled data with high dimensionality

Disclaimer: I am a novice in the world of machine learning, so please excuse my ignorance. My dataset consists of things like age, days since last visit, etc. This information is medical related. None of which is geometrical, just data pertaining to…
1
vote
1 answer

Are there any animation tools available to visualise and simulate deep neural networks?

Deep learning researchers have to work with a lot of models. The models may include different types of Layers: They include convolutional neural network layers, recurrent neural network layers, batch normalization layers, polling layers, and many…
1
vote
2 answers

How much C++ is needed for research in machine learning and artificial intelligence?

I am currently doing a master's in applied mathematics, and I recently got interested in machine learning and artificial intelligence, and I am thinking of going for a Ph.D. in this area. I have a reasonable maths and stats background, but I…
0
votes
2 answers

How can I implement a GAN network for text (review) generation?

How can I implement a GAN network for text (review) generation? Please, can someone guide me to resource (code) to help in text generation?