multimedia

Music, sound, image, video...
Higher Edu - Research dev card
Development from the higher education and research community
  • Creation or important update: 07/10/13
  • Minor correction: 07/10/13

ImagineMVS : 3D reconstruction in multiple view stereovision

This software was developed (or is under development) within the higher education and research community. Its stability can vary (see fields below) and its working state is not guaranteed.
  • Web site
  • System:
  • Current version: 20101112 - 12/11/2010
  • License(s): Proprietary licence
  • Status: internal use
  • Support: maintained, no ongoing development
  • Designer(s): Renaud Keriven
  • Contact designer(s): renaud.keriven @ acute3D.com
  • Laboratory, service: Acute3D company

 

General software features

A complete algorithmic pipeline for reconstruction of a 3D model from photographs.

The software takes as input calibrated views (that is, photographs with camera posed and oriented in space and internal parameters known). As output, it yields a textured 3D mesh. The steps are the following:

  • estimation of dense correspondences between images by plane sweeping,
  • triangulation to get a point cloud,
  • tetrahedral meshing of the point cloud and removal of hidden faces to get an initial mesh,
  • mesh optimization by incremental minimization of an energy balancing data fidelity and regularity,
  • creation from view fragments of a texture atlas to apply to the mesh.
Context in which the software is used

Internal use in IMAGINE project (École des Ponts ParisTech/CSTB).

This software is at the core of the start-up Acute3D.

Publications related to the software

Vu Hoang Hiep, Renaud Keriven, Patrick Labatut and Jean-Philippe Pons. Towards high-resolution large-scale multi-view stereo, Proceedings of CVPR 2009, pp. 1430-1437.

Higher Edu - Research dev card
Development from the higher education and research community
  • Creation or important update: 22/09/13
  • Minor correction: 22/09/13

OpenMVG : C++ library for multi-view geometry in computer vision

This software was developed (or is under development) within the higher education and research community. Its stability can vary (see fields below) and its working state is not guaranteed.
  • Web site
  • System:
  • Current version: 0.1 - 08/02/2013
  • License(s): Mozilla Public Licence - V2
  • Status: stable release
  • Support: maintained, ongoing development
  • Designer(s): Pierre Moulon
  • Contact designer(s): pmoulon @ gmail.com
  • Laboratory, service:

 

General software features

The library provides solvers for multi-view geometry, from 2 to n views:

  • homography,
  • fundamental matrix,
  • essential matrix,
  • pose estimation,
  • triangulation.

A generic framework allows using these solvers in robust estimation, as RANSAC and AC-RANSAC.

Moreover, a complete algorithmic pipeline for external calibration is provided, as a modern alternative to Bundler software.

The philosophy of this C++ library is to write clear and maintainable code. All modules have unitary tests. It relies on Eigen for linear algebra, Google's Ceres for Levenberg-Marquardt minimization and Lemon for graph processing.

Context in which the software is used

Internally used for multi-view calibration and 3D reconstruction.

Publications related to the software

Adaptive Structure from Motion with a contrario model estimation. Pierre Moulon, Pascal Monasse and Renaud Marlet. Proceedings of ACCV 2012.

Higher Edu - Research dev card
Development from the higher education and research community
  • Creation or important update: 22/09/13
  • Minor correction: 22/09/13

K-VLD : virtual line descriptor and semi-local graph matching method

This software was developed (or is under development) within the higher education and research community. Its stability can vary (see fields below) and its working state is not guaranteed.
  • Web site
  • System:
  • Current version: 20130502 - 02/05/2013
  • License(s): BSD
  • Status: stable release
  • Support: maintained, no ongoing development
  • Designer(s): Zhe Liu
  • Contact designer(s): zhe.liu @ enpc.fr
  • Laboratory, service:

 

General software features

From matching interest points between two images, the algorithm finds a set of reliable correspondences using coherency. Virtual straight lines joining interest points in the same image are encoded by a descriptor invariant w.r.t. certain geometric and photometric deformations. This descriptor should be found in virtual lines between corresponding points in another image for ensuring the coherency of both correspondences.

The algorithm is used as a discrimination step between true/false correspondences in the process of rigid or deformable registration and of stereo reconstruction.

Context in which the software is used

Illustration of a research article.

Publications related to the software

Zhe Liu, Renaud MarletVirtual Line Descriptor and Semi-Local Matching Method for Reliable Feature Correspondence.
In 23rd British Machine Vision Conference (BMVC 2012), Surrey, England, September 2012.

Higher Edu - Research dev card
Development from the higher education and research community
  • Creation or important update: 22/09/13
  • Minor correction: 22/09/13

OrsaHomography : automatic homographic registration of images

This software was developed (or is under development) within the higher education and research community. Its stability can vary (see fields below) and its working state is not guaranteed.
  • Web site
  • System:
  • Current version: 20130522 - 22/05/2013
  • License(s): LGPL
  • Status: stable release
  • Support: maintained, no ongoing development
  • Designer(s): Pierre Moulon, Pascal Monasse
  • Contact designer(s): pmo @ mikrosimage.eu
  • Laboratory, service:

 

General software features

This software registers two images by homography. This registration is meaningful in the two following situations:

  • no motion of optical center (only rotation and focal change), or
  • the observed scene is planar (painting, poster, aerial photo from high altitude...)

The software detects SIFT matching candidate points, then it sorts correct and outlier correspondences thanks to a variant of the robust estimation algorithm RANSAC. This variant uses the a contrario framework to estimate automatically the discrimination threshold.

As output, the user gets a list of matching interest points, the homography matrix, registered images, and a panorama built from the registered images by transparency.

Context in which the software is used

This software illustrates the algorithm ORSA, also known as AC-RANSAC, applied to the case of homography estimation.

Publications related to the software

Automatic Homographic Registration of a Pair of Images, with A Contrario Elimination of Outliers
Lionel Moisan, Pierre Moulon, Pascal Monasse
Image Processing On Line (IPOL), 2012.
http://dx.doi.org/10.5201/ipol.2012.mmm-oh

Higher Edu - Research dev card
Development from the higher education and research community
  • Creation or important update: 17/05/10
  • Minor correction: 03/07/12

MLV : a simplified multimedia library

This software was developed (or is under development) within the higher education and research community. Its stability can vary (see fields below) and its working state is not guaranteed.
  • Web site
  • System:
  • Current version: 0.4 - 14 april 2010
  • License(s): GPL
  • Status: stable release
  • Support: maintained, ongoing development
  • Designer(s): Adrien Boussicault, Marc Zipstein
  • Contact designer(s): adrien.boussicault(@)univ-mlv.fr
  • Laboratory, service:

 

General software features

The MLV library is a simplified multimedia library. This library has been designed for beginner students in C, and it allows to add graphical and audio effects on the student program. The library is useful to:

  • draw figures, display text and dialog boxes,
  • display images,
  • play sounds and musics,
  • catch mouse and keyboard events,
  • get informations from dialog boxes.

These tools are simplified interfaces of the SDL librairy. If you are not a C beginner, better use the SDL librairy (SDL, SDL_gfx, SDL_sound, SDL_ttf).

The MLV library is portable, and can be compiled and executed on Linux, Macintosh and Windows.

Context in which the software is used

Theaching first university level in informatics, C iniciation.

Publications related to the software
Higher Edu - Research dev card
Development from the higher education and research community
  • Creation or important update: 19/12/09
  • Minor correction: 22/03/10

Proland : an OpenGL/C++ library for the real-time rendering and editing of large scale natural scenes

This software was developed (or is under development) within the higher education and research community. Its stability can vary (see fields below) and its working state is not guaranteed.
  • Web site
  • System:
  • Current version: 2.1 - 20/07/2009
  • License(s): source code not public
  • Status: under development
  • Support: maintained, ongoing development
  • Designer(s): Eric Bruneton, Antoine Begault
  • Contact designer(s): Eric.Bruneton@inria.fr
  • Laboratory, service:

 

General software features
  • real-time rendering of multi-resolution terrains (up to a whole planet)
  • real-time rendering and editing of vector data (representing for instance roads or rivers)
  • real-time rendering of planetary atmospheres and clouds (from all viewpoints from ground to space)
  • rendering of forests using billboards

Proland can render very large natural scenes, at all scales and from all viewpoints from ground to space. The landscape data is loaded on the fly based on the current viewpoint (only the data needed for the current viewpoint is stored in memory, at the appropriate resolution). The landscape data can be procedurally modified on the fly. For instance the shape and texture of a terrain can be modified based on vector data representing roads or rivers.

Proland is based on a task graph and a cache manager taking advantage of multi-processors, supporting data prefetching to reduce disk latencies, and automatically managing the dependencis betwen tasks (procedural data are automatically recomputed when their input data change).

Context in which the software is used

Proland is used internally for research work about natural scenes (rendering, modelisation, animation). It is also used externally in two industrial projects (planetarium and flight simulator).

Publications related to the software

Scalable Real-Time Animation of Rivers
Yu Qizhi, Neyret Fabrice, Bruneton Éric, Holzschuch Nicolas
Comput. Graph. Forum, 28 (2), 239-248, 2009. Special Issue: Eurographics 2009.

Precomputed Atmospheric Scattering
Bruneton Éric, Neyret Fabrice
Comput. Graph. Forum, 27 (4), 1079-1086, 2008. Special Issue: Eurographics Symposium on Rendering 2008.

Real-time rendering and editing of vector-based terrains
Bruneton Éric, Neyret Fabrice
Comput. Graph. Forum, 27 (2), 311-320, 2008. Special Issue: Eurographics 2008.

Real-time realistic illumination and shading of stratiform clouds
Bouthors Antoine, Neyret Fabrice, Lefebvre Sylvain
Eurographics Workshop on Natural Phenomena - september 2006

Higher Edu - Research dev card
Development from the higher education and research community
  • Creation or important update: 12/12/09
  • Minor correction: 12/12/09

OpenKN : framework for modelisation, computer graphics and simulation

This software was developed (or is under development) within the higher education and research community. Its stability can vary (see fields below) and its working state is not guaranteed.
  • Web site
  • System:
  • Current version: 1.2 - july 2009
  • License(s): GPL
  • Status: stable release
  • Support: maintained, ongoing development
  • Designer(s): A. Herubel, V. Biri, V. Nozick, F. de Sorbier, F. Boutarel, B. Raynal, A. Giroud
  • Contact designer(s): biri @ univ-mlv.fr
  • Laboratory, service:

 

General software features

OpenKrakeN is a C++ framework for research and teaching purposes. It is implemented by the internal team MISS (Modelisation, Computer Graphics & Simulation) of the research team A3SI at the Laboratoire d'informatique Gaspard-Monge.

This library offers a collection of tools and methods for computer graphics, mathematics, computer vision and augmented and virtual realities.

Context in which the software is used

Used for research and developpement in our research team (for example in the Terra Numerica project). Also as a pedagogic tool in the engeneering school IMAC.

Higher Edu - Research dev card
Development from the higher education and research community
  • Creation or important update: 08/04/09
  • Minor correction: 19/03/10

PLATINE : software platform used to support remote collaboration among users.

This software was developed (or is under development) within the higher education and research community. Its stability can vary (see fields below) and its working state is not guaranteed.
  • Web site
  • System:
  • Current version: V3.0 - 24/01/2008
  • License(s): CeCILL-B
  • Status: beta release, internal use, under development
  • Support: maintained, ongoing development
  • Designer(s): VĂ©ronique Baudin , Michel Diaz, Philippe Owezarski, Thierry Villemur, Jean-Pierre Courtiat and a lot of students.
  • Contact designer(s): veronique.baudin@laas.fr
  • Laboratory, service:

 

General software features

The PLATINE environment is a software platform used to support remote collaboration among users. Two main kinds of interactions can be encountered within collaborative groups: asynchronous collaboration, that does not require the group members to be present at the same time and synchronous collaboration, where remote users work in co-presence; PLATINE is mainly devoted to synchronous collaboration.

The PLATINE environment is made up of the following components:

  • an off-line session preparation module: OSP
  • an asynchronous session state display with an “asynchronous” chat: ASSD
  • a synchronous session state display: SSD
  • a multi user visioconference: Jvisio
  • a multipoint chat: Jchat
  • an application sharing: AST
  • a shared whiteboard: SW
  • a session manager: SM

A session is composed of an asynchronous phase, and a synchronous phase.
Besides the administrator role which is associated with the single user in charge of the management of the session (creation/deletion, configuration of the session), four additional user roles have been defined, which are respectively: teacher, student, observer and expert. Thus, a user, when registering in a session, authenticates him/herself with a specific role. This role determines the rights that the user will have for using the collaboration and communication tools available in the session. The teacher and student roles are self-explanatory. The expert role is intended to implement some kind of help desk. It is detained by the users in charge of the problems and questions related to the use of the collaborative platform and/or to experiment specific applications. The observer role is intended to represent a degraded role of the student one. Typically, an observer will have a restricted access to the tools of the collaborative platform. This may be motivated by two main reasons:
- Political reasons related to the session management implying that some users are not allowed to use the full functionality of the platform
- Network QoS constraints implying that some distant users are not capable for technical reasons to use the full functionality of the platform.
Another important issue concerns the particular problem of who is in charge of controlling the floor in a active session. A typical solution to the floor control is the chaired-based control, where a human facilitator is in charge of explicitly granting and releasing floor.
In order to implement a chaired-based control, a chairman status has been defined, which may be assigned to one or a subgroup of roles. Persons who are associated with roles and are active users, are authorized to request the chairman status and to potentially gain it.

Context in which the software is used

PLATINE has been used for some experiments:

  • during the european project Lab@Future, with the following involved partners :
    ARTEC (Bremen - Germany), LAAS (Toulouse - France), ETHZ (Zurich - Switzland), TUV (Technical University of Vienna - Austria)
  • during a contract of collaboration (Co-supervision of thesis) between the University of Tokushima (Japan) and the LAAS for some sessions of e-learning (to learn english language) and for work sessions between some members of LAAS and a student at Tokushima University.

It is used today to illustrate various protocols in projects such as SatSIX , or UseNET for an automatic deployment of its components by using a OSGi technology.

Publications related to the software

A lot of documents and articles have been published :

  • A list of articles is available here
  • Some guides are available here
Syndicate content