Shortcuts

Function at::_scaled_dot_product_flash_attention

Function Documentation

inline ::std::tuple<at::Tensor, at::Tensor, at::Tensor, at::Tensor, c10::SymInt, c10::SymInt, at::Tensor, at::Tensor, at::Tensor> at::_scaled_dot_product_flash_attention(const at::Tensor &query, const at::Tensor &key, const at::Tensor &value, double dropout_p = 0.0, bool is_causal = false, bool return_debug_mask = false, ::std::optional<double> scale = ::std::nullopt)

Docs

Access comprehensive developer documentation for PyTorch

View Docs

Tutorials

Get in-depth tutorials for beginners and advanced developers

View Tutorials

Resources

Find development resources and get your questions answered

View Resources