View source for SNIC Emerging Technologies

{{project info
|description=Coordinating new and emerging technologies within SNIC.
|fields=Emerging Technologies
|financing=SNIC
|active=yes
|start date=2014-05-01
|end date=
}}

Currently, many SNIC centres are continuously investigate the market for current developments in emerging technologies and even buy hardware for evaluation. However, in many of these activities user involvement is limited and efforts are often duplicated between centres. This activity aims to coordinate these efforts and competence within SNIC and provide SNIC users and communities with early access to new technologies. The project will also work closely with the user communities to see if they have interests in upcoming technologies.

Three focus areas have been defined:

# Storage Technologies (C3SE, HPC2N)
# Access-methods and remote visualisation (Lunarc, UPPMAX)
# Future HPC and Accelerators (Lunarc, PDC, HPC2N)

== Storage Technologies ==

There are many storage technologies employed within SNIC. To be able to deploy solutions that are suitable for different usage scenarios, it is important that there is a continuous evaluation of availa-ble storage technologies. It is also important that prototype solutions are evaluated closely to users and facilities. Typical projects within this focus area could be:

* File systems for different I/O patterns.
* New storage hardware.
* Higher-level file services.
* Client tools for accessing available resources.
* Integration services.

'''Objectives and deliverables'''

* Investigate how existing resources can be facilitated in new ways and how new approaches for users on how to use existing solutions can be facilitated to provide better support for I/O-intensive simulations and work-flows. (C3SE)
* Investigate how the RobinHood service of Lustre v2+ filestystems can be used in conjunction with Tivoli TSM to speed up incremental backups. (C3SE, HPC2N)
* Investigate how the RobinHood service of Lustre v2+ filesystems can be used to provide more fine-grained quotas, ex. for project storage etc. (C3SE)
* One solution that has been used in SNIC for a number of years for long-term storage of re-search data is dCache in combination with TSM for archiving to tape. There are several al-ternatives to using TSM for archiving to tape, which should be further studied both from a performance and cost effectiveness. One example is LTFS [3]. To look at various options for long-term storage is also something that connects well to activities within WLCG and EIS-CAT_3D for which HPC2N are involved in. (HPC2N)

== Access-methods and remote visualisation ==

To improve the usability of our HPC resources, many centres have been providing remote desktop solutions to users in an effort to provide a richer user experience in HPC. The service has been a great success in the research groups and the number of users is increasing. Requests for new applications and usage are increasing steadily. 
However, the increasing user base and request for new applications and usages has raised questions on how to efficiently scale these services in many dimensions.

* Monitoring of usage patterns on the desktop servers.
* Monitoring and scaling of distribution networks using different usage patterns and desktop configurations such as spatial resolution.
* How to provide seamless access to hardware accelerated desktop services.
* How to provide interactive access to applications and specific hardware configurations (e.g. GPU enabled nodes) through the batch-systems in a transparent way in the same desktop environment.

Identifying bottlenecks in remote desktop architectures.

'''Objectives and deliverables'''

Remote desktop service aspects:

* Evaluate different remote-access architectures based on target network specifications.
* Develop best practice guides for configuration and setup of remote desktop services.
* Evaluate techniques for monitoring the load and usage of the servers providing the desktop services, so that the user experience is good. Analyse usage bottlenecks and identify areas for improvement such as easy and (eventually) integrated SFTP file transfer.

Access to hardware accelerated graphics:

* Implement prototypes for providing a scalable and OS independent hardware accelerated back-end to the desktop interface. This can involve taking advantage of single or multiple GPU nodes as a provider for graphical acceleration.

Interactive use of graphical user interfaces:

* Developing an on-demand hardware allocation mechanism using the queuing system to enable unique per-session access to unique hardware resources e.g. CPU or accelerator equipped nodes.
* Defining community specific desktops.



== Members ==
{{#ask: [[Category:Person]] [[project::{{PAGENAME}}]]
|?centre
|?role
|?field
}}