Skip to content

Commit

Permalink
doc: add doc for SYCL pool and lnorm
Browse files Browse the repository at this point in the history
  • Loading branch information
densamoilov committed Mar 24, 2023
1 parent 38153b9 commit f7bd665
Showing 1 changed file with 31 additions and 0 deletions.
31 changes: 31 additions & 0 deletions src/gpu/nvidia/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -330,6 +330,21 @@ backward propagation respectively.

* Supported data type are `f32`, `f16`, `bf16` and `s8`.

#### Using SYCL Kernels

The implementation supports both forward and backward directions.

* Supported formats: `NCDHW`, `NDHWC`, `NCHW`, `NHWC`, `NCW`, `NWC`

##### Forward Direction
* Supported data types: `f32`, `bf16`, `f16`, `s8`, `u8` and `s32`
* Supported post-ops: `binary`, `eltwise_linear`
* Supported algorithms: `max`, `avg_p`, `avg_np`

##### Backward Direction
* Supported data types: `f32`, `bf16`, `f16`
* Supported algorithms: `max`, `avg_p`, `avg_np`

### PReLU

The PReLU primitive (Leaky ReLU with a trainable alpha parameter) is implemented
Expand All @@ -341,6 +356,22 @@ propagations.
* Forward pass supports `f32`, `f16`, `bf16`, `s8` and `u8` data types
* Backward pass supports `f32` and `bf16` data types

### Layer Normalization

The Primitive layer normalization is implemented through SYCL kernels.The implementation supports both forward and backward directions.

* Supported formats: `NCDHW`, `NDHWC`, `NCHW`, `NHWC`, `NCW`, `NWC`, `NC`

##### Forward direction
* Supported data types for source and destination: `f32`, `bf16`, `f16`, `s8`, `u8`
* Supported attributes: `Scales`
* Supported flags: `dnnl_global_stats`, `dnnl_use_scale`, `dnnl_use_shift`

##### Backward direction
* Supported data types for source and destination: `f32`, `bf16`, `f16`
* Supported data types for mean and variance: `f32`
* Supported flags: `dnnl_global_stats`, `dnnl_use_scale`, `dnnl_use_shift`

### Reorder

The `cudnnTransform` function is the equivalent of oneDNN reorder function.
Expand Down

0 comments on commit f7bd665

Please sign in to comment.