About
Authors
Tim Gollub
Martin Potthast
Benno Stein
Steven Burrows
Dennis Hoppe
Martin Trenkmann
Steve Göring
Students
Anna Beyer
Matthias Busse
Clement Welsch
Arnd Oberländer
Johannes Kiesel
Adrian Teschendorf
Manuel Willem
Information
Type: Crowd-Sourcing Tool, Metadata Archive
License: Closed Source
Timeline: 2014-
Institution: Bauhaus-Universität Weimar (University)
Links
Main Page - tira.io
Motivation
From their about page:
The possibility to reproduce and compare results of other researchers is essential for scientific progress. In many research fields, however, it is often impossible to specify the complete experiment setting; e.g., in the scope of a scientific publication. As a consequence, a reliable comparison becomes difficult, if not impossible. TIRA is our approach to address this shortcoming. TIRA—jokingly, "The Incredible Research Assistant"—provides a means for evaluation as a service. It focuses on hosting shared tasks and facilitates the submission of softwares as opposed to the output of running a software on a test dataset (a so-called run). TIRA encapsulates the submitted softwares into virtual machines. This way, even after a shared task is over, the submitted softwares can be re-evaluated at the click of a button, which severely increased the reproducibility of the corresponding shared task.
Rubric
✔ - Yes
✗ - No
○ - Yes, but with concession
· - Inapplicable
? - Unknown
| Infrastructure | ||
| Self-Hosting | ❓ | |
| Provides Metadata | ❓ | |
| Provides Hardware Diversity | ❓ | |
| Dispatches Work to Cloud Machines | ❓ | |
| Provides a Web Portal | ❓ | |
| Provides Performance Monitoring | ❓ |
| Capabilities | ||
| Runs Code | ❓ | |
| File Storage | ❓ | |
| Collaboration Controls | ❓ | |
| Provides Citations | ❓ | |
| Interactive Graphing | ❓ | |
| Can Combine Objects Interactively | ❓ | |
| Can Archive/Run GUI Tools | ❓ | |
| Can Hook to External Services | ❓ |
| Access | ||
| Public view of object | ❓ | |
| Access Permissions for Editing | ❓ | |
| Access Permissions for Reading | ❓ | |
| Access Permissions for Anon Review | ❓ |
| Provenance | ||
| Search | ❓ | |
| Globally Unique Identifiers for Projects | ❓ | |
| Provides URL to Project / Data | ❓ |
| Governance | ||
| Open Source | ✗ | No source code has been linked. |
| Allows Modification / Redistribution | ✗ | |
| Has a Free-to-Use Package | ✔ | |
| Has a Student Package | ❓ | |
| Has a Paid Package | ❓ |
Walkthrough
Infrastructure
Capabilities
Access
Provenance
Governance
Strengths
To be discussed.
Breakdown
Weaknesses
To be discussed.
Breakdown
Unique Features
To be discussed.
Best-Practice Influences
To be discussed.
Digital Library Incorporation Issues
To be discussed.
Applied Use-cases
To be discussed.