# Converting single-cell data structures between Bioconductor and Python

Luke Zappia* and Aaron Lun**

* luke@lazappi.id.au
** infinite.monkeys.with.keyboards@gmail.com

#### Revised: 19 October 2021

#### Package

zellkonverter 1.4.0

# 1 Overview

This package provides a lightweight interface between the Bioconductor `SingleCellExperiment` data structure and the Python `AnnData`-based single-cell analysis environment. The idea is to enable users and developers to easily move data between these frameworks to construct a multi-language analysis pipeline across R/Bioconductor and Python.

# 2 Reading and writing H5AD files

The `readH5AD()` function can be used to read a `SingleCellExperiment` from a H5AD file. This can be manipulated in the usual way as described in the SingleCellExperiment documentation.

    library(zellkonverter)

    # Obtaining an example H5AD file.
    example_h5ad <- system.file("extdata", "krumsiek11.h5ad",
                                package = "zellkonverter")
    readH5AD(example_h5ad)

    ## class: SingleCellExperiment
    ## dim: 11 640
    ## metadata(2): highlights iroot
    ## assays(1): X
    ## rownames(11): Gata2 Gata1 ... EgrNab Gfi1
    ## rowData names(0):
    ## colnames(640): 0 1 ... 158-3 159-3
    ## colData names(1): cell_type
    ## reducedDimNames(0):
    ## mainExpName: NULL
    ## altExpNames(0):

We can also write a `SingleCellExperiment` to a H5AD file with the `writeH5AD()` function. This is demonstrated below on the classic Zeisel mouse brain dataset from the scRNAseq package. The resulting file can then be directly used in compatible Python-based analysis frameworks.

    library(scRNAseq)

    sce_zeisel <- ZeiselBrainData()
    out_path <- tempfile(pattern = ".h5ad")
    writeH5AD(sce_zeisel, file = out_path)

# 3 Converting between `SingleCellExperiment` and `AnnData` objects

Developers and power users who control their Python environments can directly convert between `SingleCellExperiment` and `AnnData` objects using the `SCE2AnnData()` and `AnnData2SCE()` utilities. These functions expect that reticulate has already been loaded along with an appropriate version of the anndata package. We suggest using the basilisk package to set up the Python environment before using these functions.

    library(basilisk)
    library(scRNAseq)

    seger <- SegerstolpePancreasData()
    roundtrip <- basiliskRun(fun = function(sce) {
         # Convert SCE to AnnData:
         adata <- SCE2AnnData(sce)

         # Maybe do some work in Python on 'adata':
         # BLAH BLAH BLAH

         # Convert back to an SCE:
         AnnData2SCE(adata)
    }, env = zellkonverterAnnDataEnv, sce = seger)

Package developers can guarantee that they are using the same versions of Python packages as zellkonverter by using the `.AnnDataDependencies` variable to set up their Python environments.

    .AnnDataDependencies

    ## [1] "anndata==0.7.6"  "h5py==3.2.1"     "hdf5==1.10.6"    "natsort==7.1.1"
    ## [5] "numpy==1.20.2"   "packaging==20.9" "pandas==1.2.4"   "scipy==1.6.3"
    ## [9] "sqlite==3.35.5"

# 4 Progress messages

By default the functions in zellkonverter don’t display any information about their progress but this can be turned on by setting the `verbose = TRUE` argument.

    readH5AD(example_h5ad, verbose = TRUE)

    ## class: SingleCellExperiment
    ## dim: 11 640
    ## metadata(2): highlights iroot
    ## assays(1): X
    ## rownames(11): Gata2 Gata1 ... EgrNab Gfi1
    ## rowData names(0):
    ## colnames(640): 0 1 ... 158-3 159-3
    ## colData names(1): cell_type
    ## reducedDimNames(0):
    ## mainExpName: NULL
    ## altExpNames(0):

If you would like to see progress messages for all functions by default you can turn this on using the `setZellkonverterVerbose()` function.

    # This is not run here
    setZellkonverterVerbose(TRUE)

# 5 Session information

    sessionInfo()

    ## R version 4.1.1 (2021-08-10)
    ## Platform: x86_64-pc-linux-gnu (64-bit)
    ## Running under: Ubuntu 20.04.3 LTS
    ##
    ## Matrix products: default
    ## BLAS:   /home/biocbuild/bbs-3.14-bioc/R/lib/libRblas.so
    ## LAPACK: /home/biocbuild/bbs-3.14-bioc/R/lib/libRlapack.so
    ##
    ## locale:
    ##  [1] LC_CTYPE=en_US.UTF-8       LC_NUMERIC=C
    ##  [3] LC_TIME=en_GB              LC_COLLATE=C
    ##  [5] LC_MONETARY=en_US.UTF-8    LC_MESSAGES=en_US.UTF-8
    ##  [7] LC_PAPER=en_US.UTF-8       LC_NAME=C
    ##  [9] LC_ADDRESS=C               LC_TELEPHONE=C
    ## [11] LC_MEASUREMENT=en_US.UTF-8 LC_IDENTIFICATION=C
    ##
    ## attached base packages:
    ## [1] stats4    stats     graphics  grDevices utils     datasets  methods
    ## [8] base
    ##
    ## other attached packages:
    ##  [1] basilisk_1.6.0              scRNAseq_2.7.2
    ##  [3] SingleCellExperiment_1.16.0 SummarizedExperiment_1.24.0
    ##  [5] Biobase_2.54.0              GenomicRanges_1.46.0
    ##  [7] GenomeInfoDb_1.30.0         IRanges_2.28.0
    ##  [9] S4Vectors_0.32.0            BiocGenerics_0.40.0
    ## [11] MatrixGenerics_1.6.0        matrixStats_0.61.0
    ## [13] zellkonverter_1.4.0         knitr_1.36
    ## [15] BiocStyle_2.22.0
    ##
    ## loaded via a namespace (and not attached):
    ##  [1] ProtGenerics_1.26.0           bitops_1.0-7
    ##  [3] bit64_4.0.5                   progress_1.2.2
    ##  [5] filelock_1.0.2                httr_1.4.2
    ##  [7] rprojroot_2.0.2               tools_4.1.1
    ##  [9] bslib_0.3.1                   utf8_1.2.2
    ## [11] R6_2.5.1                      lazyeval_0.2.2
    ## [13] DBI_1.1.1                     withr_2.4.2
    ## [15] prettyunits_1.1.1             tidyselect_1.1.1
    ## [17] bit_4.0.4                     curl_4.3.2
    ## [19] compiler_4.1.1                cli_3.0.1
    ## [21] basilisk.utils_1.6.0          xml2_1.3.2
    ## [23] DelayedArray_0.20.0           rtracklayer_1.54.0
    ## [25] bookdown_0.24                 sass_0.4.0
    ## [27] rappdirs_0.3.3                Rsamtools_2.10.0
    ## [29] stringr_1.4.0                 digest_0.6.28
    ## [31] rmarkdown_2.11                XVector_0.34.0
    ## [33] pkgconfig_2.0.3               htmltools_0.5.2
    ## [35] ensembldb_2.18.0              dbplyr_2.1.1
    ## [37] fastmap_1.1.0                 rlang_0.4.12
    ## [39] RSQLite_2.2.8                 shiny_1.7.1
    ## [41] BiocIO_1.4.0                  jquerylib_0.1.4
    ## [43] generics_0.1.1                jsonlite_1.7.2
    ## [45] BiocParallel_1.28.0           dplyr_1.0.7
    ## [47] RCurl_1.98-1.5                magrittr_2.0.1
    ## [49] GenomeInfoDbData_1.2.7        Matrix_1.3-4
    ## [51] Rcpp_1.0.7                    fansi_0.5.0
    ## [53] reticulate_1.22               lifecycle_1.0.1
    ## [55] stringi_1.7.5                 yaml_2.2.1
    ## [57] zlibbioc_1.40.0               BiocFileCache_2.2.0
    ## [59] AnnotationHub_3.2.0           grid_4.1.1
    ## [61] blob_1.2.2                    parallel_4.1.1
    ## [63] promises_1.2.0.1              ExperimentHub_2.2.0
    ## [65] crayon_1.4.1                  dir.expiry_1.2.0
    ## [67] lattice_0.20-45               Biostrings_2.62.0
    ## [69] GenomicFeatures_1.46.0        hms_1.1.1
    ## [71] KEGGREST_1.34.0               pillar_1.6.4
    ## [73] rjson_0.2.20                  biomaRt_2.50.0
    ## [75] XML_3.99-0.8                  glue_1.4.2
    ## [77] BiocVersion_3.14.0            evaluate_0.14
    ## [79] BiocManager_1.30.16           png_0.1-7
    ## [81] vctrs_0.3.8                   httpuv_1.6.3
    ## [83] purrr_0.3.4                   assertthat_0.2.1
    ## [85] cachem_1.0.6                  xfun_0.27
    ## [87] mime_0.12                     xtable_1.8-4
    ## [89] AnnotationFilter_1.18.0       restfulr_0.0.13
    ## [91] later_1.3.0                   tibble_3.1.5
    ## [93] GenomicAlignments_1.30.0      AnnotationDbi_1.56.0
    ## [95] memoise_2.0.0                 ellipsis_0.3.2
    ## [97] interactiveDisplayBase_1.32.0 here_1.0.1