Requirements

The purpose of presenting these requirements is to inform the community about the present capabilities of the EE-UQ app and features that could be added. The original set of requirements has come from a set of grand challenge reports, GC. These original requirements have been broken into a smaller set of deliverable features by the senior faculty associated with the project, SP. Additional requirements have come from users, U. See section Feature Requests if you have additional features you would like to see.

quoFEM Requirements

Requirements - QF

#

Description

Source

Priority

Status

Implementation

QF

Application to promote and aid use of UQ methods in NHE research for response estimation, surrogate modeling, and calibration

GC

M

InProgress

QF.1

Ability to use Various UQ Methods and Variable Options

QF.1.1

Ability to use Forward Propagtion methods listed in UQ under UF

SP

M

Implemented

qfem-0001

QF.1.2

Ability to use Random Variable Distributions defined in RV

SP

M

Implemented

qfem-0001

QF.1.3

Ability to use Reliability Methods listed in UQ under UR

SP

M

Implemented

qfem-0001

QF.1.4

Ability to use Global Sensitivity Methods listed in UQ under UG

SP

M

Implemented

qfem-0009

QF.1.5

Ability to both use and create surrogates listed in UQ under US

SP

M

Implemented

qfem-0016

QF.1.6

Ability to use High Dimensional UQ listed in UQ under UH

SP

M

InProgress

qfem-0022

QF.1.7

Ability to use Bayesian Calibration methods listed in UQ under UB

SP

M

InProgress

qfem-0014

QF.1.8

Ability to use Nonlinear Least Squares methods listed in UQ under UN

SP

M

Implemented

qfem-0007

QF.2

Ability to use Different Simulation Applications

QF.2.1

Ability to use OpenSees

SP

M

Implemented

qfem-0001

QF.2.2

Ability to use OpenSeesPy

SP

M

Implemented

qfem-0002

QF.2.3

Ability to Incorporate User Own Applications

UF

M

Implemented

qfem-0005

QF.3

Ability to Visualize the Results

SP

M

Implemented

QF.3.1

Ability to view individual sample results

SP

M

Implemented

qfem-0001

QF.3.2

Ability to graphically view the results to show distribution in respone

SP

M

Implemented

qfem-0001

QF.3.2

Ability to view statistical measures of response

SP

M

Implemented

qfem-0001

QF.4

Miscellaneous User Requests

QF.4.1

Run application from command line, include option to run remotely

UF

D

QF.5

General Software Requirements

QF.5.1

Application to Provide Common SimCenter Research Application Requirements listed in CR

GC

M

InProgress
Key:
Source: GC=Needed for Grand Challenges, SP=Senior Personnel, UF=User Feedback
Priority: M=Mandatory, D=Desirable, P=Possible Future
Status: Implemented, InProgress, and Blank (i.e. not started)
Implementation: UM=User Manual, DM=Developer Manual, SC=Source Code

UQ Requirements

Requirements - Uncertainty Quantification Methods and Variables

#

Description

Source

Priority

Status

Implementation

UF.1

Ability to use basic Monte Carlo and LHS methods

SP

M

Implemented

qfem-0001

UF.2

Ability to use Gaussian Process Regression

SP

M

Implemented

UM

UF.3

Ability to use Multi-Scale Monte Carlo

SP

M

_

_

UF.4

Ability to use Multi-Fidelity Models

SP

M

Implemented

UM

UF.5

Ability to use Multi-model Forward Propagation

UF

D

Implemented

qfem-0027

UR.1

Ability to use First Order Reliability method

SP

M

Implemented

qfem-0001

UR.2

Ability to use Second Order Reliability method

SP

M

Implemented

UM

UR.3

Ability to use Surrogate Based Reliability

SP

M

Implemented

UM

UR.4

Ability to use Importance Sampling

SP

M

Implemented

UM

UG.1

Ability to obtain Global Sensitivity Sobol indices

UF

M

Implemented

qfem-0001

UG.2

Ability to use probability model-based global sensitivity analysis (PM-GSA)

SP

M

Implemented

qfem-0009

UG.3

Ability to use probability model-based global sensitivity analysis (PM-GSA) for high-dimensional outputs

UF

D

Implemented

qfem-0023

US.1

Ability to Construct Gaussian Process (GP) Regression Model from a Simulation Model

SP

M

Implemented

qfem-0016

US.2

Ability to Construct GP Regression Model from Input-output Dataset

SP

M

Implemented

UM

US.3

Ability to use Surrogate Model for UQ Analysis

SP

M

Implemented

qfem-0016

US.4

Ability to Save the Surrogate Model

SP

M

Implemented

qfem-0016

US.5

Ability to Use Adaptive Design of Experiments

SP

M

Implemented

UM

US.6

Ability to Assess Reliability of Surrogate Model

SP

M

Implemented

qfem-0016

US.7

Ability to Build Surrogate Under Stochastic Excitation

SP

M

Implemented

qfem-0025

US.8

Ability to Use Physics-Informed Machine Learning

SP

M

_

_

UN.1

Ability to use Gauss-Newton solvers for parameter estimation

SP

M

Implemented

qfem-0007

UN.2

Ability to read calibration data from a file

UF

M

Implemented

qfem-0007

UN.3

Ability to handle non-scalar response quantities

UF

M

Implemented

qfem-0007

UN.4

Ability to run gradient-free parameter estimation

UF

D

Implemented

UM

UB.1

Ability to use DREAM algorithm for Bayesian inference

SP

M

Implemented

UM

UB.2

Ability to use TMCMC algorithm for Bayesian inference

SP

M

Implemented

qfem-0014

UB.3

Ability to read calibration data from a file

UF

M

Implemented

qfem-0014

UB.4

Ability to handle non-scalar response quantities

UF

M

Implemented

qfem-0014

UB.5

Ability to calibrate multipliers on error covariance

UF

M

Implemented

qfem-0014

UB.6

Ability to use a default log-likelihood function

UF

M

Implemented

qfem-0014

UB.7

Ability to use Kalman Filtering

UF

M

_

_

UB.8

Ability to use Particle Filtering

UF

M

_

_

UB.9

Ability to perform model-class selection/averaging

UF

D

Implemented

qfem-0029

UB.10

Ability to perform hierarchical Bayesian calibration

UF

D

Implemented

qfem-0028

UB.11

Ability to perform surrogate-aided Bayesian calibration

UF

D

In Progress

1.1.2.3.4

UH.1

Ability to sample from manifold

SP

M

Implemented

qfem-0022

UH.2

Ability to build Reduced Order Model

SP

M

In Progress

1.2.4.4

UO.1

Ability to use User-Specified External UQ Engine

SP

M

Implemented

qfem-0017

UO.2

Ability to use Own External FEM Application

UF

M

Implemented

UM

UO.3

Ability to use UQ Engines other than SimCenterUQ, Dakota, or UCSD-UQ

UF

P

_

_
Key:
Source: GC=Needed for Grand Challenges, SP=Senior Personnel, UF=User Feedback
Priority: M=Mandatory, D=Desirable, P=Possible Future
Status: Implemented, InProgress, and Blank (i.e. not started)
Implementation: UM=User Manual, DM=Developer Manual, SC=Source Code

RV Requirements

Requirements - CR

#

Description

Source

Priority

Status

Implementation

RV.1

Various Random Variable Probability Distributions

RV.1.1

Normal

SP

M

Implemented

qfem-0001

RV.1.2

Lognormal

SP

M

Implemented

qfem-0001

RV.1.3

Uniform

SP

M

Implemented

qfem-0014

RV.1.4

Beta

SP

M

Implemented

qfem-0002

RV.1.5

Weibull

SP

M

Implemented

qfem-0002

RV.1.6

Gumbel

SP

M

Implemented

qfem-0000

RV.1.7

Exponential

SP

M

Implemented

qfem-0000

RV.1.8

Discrete

SP

M

Implemented

qfem-0000

RV.1.9

Gamma

SP

M

Implemented

qfem-0000

RV.1.10

Chi-squared

SP

M

Implemented

qfem-0000

RV.1.11

Truncated Exponential

SP

M

Implemented

qfem-0000

RV.2

User-defined Distribution

SP

M

_

_

RV.3

Define Correlation Matrix

SP

M

Implemented

qfem-0009

RV.4

Random Fields

SP

M

_

_

RV.5

Ability to View Graphically the density function when defining the RV

UF

D

Implemented

qfem-0009
Key:
Source: GC=Needed for Grand Challenges, SP=Senior Personnel, UF=User Feedback
Priority: M=Mandatory, D=Desirable, P=Possible Future
Status: Implemented, InProgress, and Blank (i.e. not started)
Implementation: UM=User Manual, DM=Developer Manual, SC=Source Code

Common Research Application Requirements

Requirements - CR

#

Description

Source

Priority

Status

Implementation

CR.1

Open-source software where developers can test new data and develop algorithms

CR.1.1

Provide open-source applications utilizing code hosting platforms, e.g. GitHub

SP

M

Implemented

quoFEM

CR.1.2

Assign an open-source license that allows free use

SP

M

Implemented

quoFEM

CR.2

Ability to use multiple coupled resources (applications, databases, viz tools) by Practicing Engineers

CR.2.1

Allow users to launch scientific workflows

SP

M

Implemented

quoFEM

CR.3

Ability to utilize resources beyond the desktop including HPC

CR.3.1

Allow users to utilize HPC resources at TACC through DesignSafe

SP

M

Implemented

quoFEM

CR.4

Efficient use of multiple coupled and linked models requiring sharing and inter-operability of databases, computing environments, networks, visualization tools, and analysis systems

CR.4.1

Identify and include external analysis systems

SP

M

InProgress

_

CR.4.2

Identify and include external databases

SP

M

InProgress

_

CR.4.3

Identify and include external viz tools

SP

M

InProgress

_

CR.4.4

Identify and include external computing env

SP

M

Inprogress

1.1.2.5.5

CR.5

Tool available for download from web

CR.5.1

Tool downloadable from DesignSafe website

GC

M

Implemented

quoFEM

CR.6

Ability to benefit from programs that move research results into practice and obtain training

CR.6.1

Ability to use educational provisions to gain interdisciplinary education for expertise in earth sciences and physics, engineering mechanics, geotechnical engineering, and structural engineering to be qualified to perform these simulations

GC

D

_

_

CR.6.2

Documentation exists demonstrating application usage

SP

M

Implemented

_

CR.6.3

Video exists demonstrating application usage

SP

M

Implemented

_

CR.6.4

Tool training through online and in-person training events

SP

M

Implemented

_

CR.7

Verification examples exist

SP

M

Implemented

quoFEM

CR.8

Validation of proposed analytical models against existing empirical datasets

CR.8.1

Validation examples exist, validated against tests or other software

GC

M

_

CR.9

Tool to allow users to load and save user inputs

SP

M

Implemented

core

CR.10

Installer which installs the application and all needed software

UF

D

Implemented

quoFEM
Key:
Source: GC=Needed for Grand Challenges, SP=Senior Personnel, UF=User Feedback
Priority: M=Mandatory, D=Desirable, P=Possible Future
Status: Implemented, InProgress, and Blank (i.e. not started)
Implementation: UM=User Manual, DM=Developer Manual, SC=Source Code