# miRSM: inferring miRNA sponge modules in heterogeneous data
Author: Junpeng Zhang (zhangjunpeng_411@yahoo.com) School of Engineering, Dali University
Date: 2021-05-19

\ Junpeng Zhang (zhangjunpeng_411@yahoo.com)\ School of Engineering, Dali University

#### 2021-05-19

# Contents

# 1 Introduction

MicroRNAs (miRNAs) play key roles in many biological processes including cancers [1-5]. Thus, uncovering miRNA functions and regulatory mechanisms is important for gene diagnosis and therapy.

Previous studies [6-9] have shown that a pool of coding and non-coding RNAs that shares common miRNA biding sites competes with each other, thus alter miRNA activity. The corresponding regulatory mechanism is named competing endogenous RNA (ceRNA) hypothesis [10]. These RNAs are called ceRNAs or miRNA sponges or miRNA decoys, and include long non-coding RNAs (lncRNAs), pseudogenes, circular RNAs (circRNAs) and messenger RNAs (mRNAs), etc. To study the module-level properties of miRNA sponges, it is necessary to identify miRNA sponge modules. The miRNA sponge modules will help to reveal the biological mechanism in cancer.

To speed up the research of miRNA sponge modules, we develop an R/Bioconductor package ‘miRSM’ to infer miRNA sponge modules. Unlike the existing R/Bioconductor packages (‘miRspongeR’ and ‘SPONGE’), ‘miRSM’ focuses on identifying miRNA sponge modules by integrating expression data and miRNA-target binding information instead of miRNA sponge interaction networks.

# 2 Identification of gene modules

Given matched ceRNA and mRNA expression data, we infer gene modules by using several methods from 21 packages, including ‘WGCNA’, ‘GFA’, ‘igraph’, ‘ProNet’, ‘NMF’, ‘stats’, ‘flashClust’, ‘dbscan’, ‘subspace’, ‘mclust’, ‘SOMbrero’, ‘ppclust’, ‘biclust’, ‘runibic’, ‘iBBiG’, ‘fabia’, ‘BicARE’, ‘isa2’, ‘s4vd’, ‘BiBitR’ and ‘rqubic’. We assemble these methods into 7 functions: module_WGCNA, module_GFA, module_igraph, module_ProNet, module_NMF, module_clust and module_biclust.

## 2.1 Load BRCA sample data

The BRCA sample data includes matched miRNA, lncRNA, mRNA expression data, putative miRNA-target binding information and BRCA-related genes (lncRNAs and mRNAs).

    data(BRCASampleData)

## 2.2 module_WGCNA

By using WGCNA method [11], we identify co-expressed gene modules from matched ceRNA and mRNA expression data.

    modulegenes_WGCNA <- module_WGCNA(ceRExp[, seq_len(80)],
                                      mRExp[, seq_len(80)])

    ##    Power SFT.R.sq  slope truncated.R.sq mean.k. median.k. max.k.
    ## 1      1   0.0755  0.331       -0.10700  54.100  65.50000  83.70
    ## 2      2   0.0476 -0.260        0.09470  28.000  33.30000  56.60
    ## 3      3   0.1720 -0.315        0.40700  17.100  18.20000  41.80
    ## 4      4   0.2940 -0.400        0.26500  11.400  10.30000  32.80
    ## 5      5   0.5200 -0.518        0.41100   7.970   5.99000  26.50
    ## 6      6   0.7650 -0.599        0.72800   5.770   3.55000  21.90
    ## 7      7   0.8470 -0.644        0.87100   4.290   2.14000  18.30
    ## 8      8   0.7110 -0.740        0.70500   3.260   1.31000  15.40
    ## 9      9   0.1560 -1.720        0.07550   2.520   0.81700  13.10
    ## 10    10   0.1690 -1.850        0.08770   1.980   0.52000  11.30
    ## 11    12   0.8620 -0.954        0.89900   1.260   0.22000   8.43
    ## 12    14   0.8510 -1.030        0.85100   0.844   0.09870   6.44
    ## 13    16   0.1800 -1.910        0.00065   0.584   0.04630   4.99
    ## 14    18   0.1850 -1.870        0.01020   0.417   0.02160   3.91
    ## 15    20   0.9260 -1.030        0.96000   0.305   0.00998   3.11
    ## ..connectivity..
    ## ..matrix multiplication (system BLAS)..
    ## ..normalization..
    ## ..done.

    modulegenes_WGCNA

    ## GeneSetCollection
    ##   names: Module 1 (1 total)
    ##   unique identifiers: A2M-AS1, EMX2OS, ..., GRASP (36 total)
    ##   types in collection:
    ##     geneIdType: NullIdentifier (1 total)
    ##     collectionType: NullCollection (1 total)

## 2.3 module_GFA

The gene modules are identified by using GFA method [12, 13] from matched ceRNA and mRNA expression data.

    modulegenes_GFA <- module_GFA(ceRExp[seq_len(20), seq_len(15)],
                                  mRExp[seq_len(20), seq_len(15)],
                                  iter.max = 2600)
    modulegenes_GFA

## 2.4 module_igraph

By using ‘igraph’ package [14], we infer gene modules from matched ceRNA and mRNA expression data. In the ‘igraph’ package, we can select “betweenness”, “greedy”, “infomap”, “prop”, “eigen”, “louvain”, “walktrap” methods for gene module identification. The default method is “greedy”.

    modulegenes_igraph <- module_igraph(ceRExp[, seq_len(10)],
                                        mRExp[, seq_len(10)])
    modulegenes_igraph

    ## GeneSetCollection
    ##   names: Module 1, Module 2 (2 total)
    ##   unique identifiers: A2M-AS1, ABCA11P, ..., E2F8 (19 total)
    ##   types in collection:
    ##     geneIdType: NullIdentifier (1 total)
    ##     collectionType: NullCollection (1 total)

## 2.5 module_ProNet

In the ‘ProNet’ package, we can select FN [15], MCL [16], LINKCOMM [17] and MCODE [18] for gene module identification. The default method is MCL.

    modulegenes_ProNet <- module_ProNet(ceRExp[, seq_len(10)],
                                        mRExp[, seq_len(10)])
    modulegenes_ProNet

    ## GeneSetCollection
    ##   names: Module 1, Module 2 (2 total)
    ##   unique identifiers: A2M-AS1, ACVR2B-AS1, ..., E2F7 (12 total)
    ##   types in collection:
    ##     geneIdType: NullIdentifier (1 total)
    ##     collectionType: NullCollection (1 total)

## 2.6 module_NMF

By using ‘NMF’ package [20], we infer gene modules from matched ceRNA and mRNA expression data. In the ‘NMF’ package, we can select “brunet”, “Frobenius”, “KL”, “lee”, “nsNMF”, “offset”, “siNMF”, “snmf/l”, “snmf/r” methods for gene module identification. The default method is “brunet”.

    # Reimport NMF package to avoid conflicts with DelayedArray package
    library(NMF)
    modulegenes_NMF <- module_NMF(ceRExp[, seq_len(10)],
                                  mRExp[, seq_len(10)])
    modulegenes_NMF

    ## GeneSetCollection
    ##   names:  (0 total)
    ##   unique identifiers:  (0 total)
    ##   types in collection:
    ##     geneIdType:  (0 total)
    ##     collectionType:  (0 total)

## 2.7 module_clust

We Identify gene modules from matched ceRNA and mRNA expression data using a series of clustering packages, including stats [21], flashClust [22], dbscan [23], subspace [24], mclust [25], SOMbrero [26] and ppclust [27]. The clustering methods include “kmeans”, “hclust,”dbscan, “clique,”gmm, “som” and “fcm”. The default method is “kmeans”.

    modulegenes_clust <- module_clust(ceRExp[, seq_len(30)],
                                      mRExp[, seq_len(30)])
    modulegenes_clust

    ## GeneSetCollection
    ##   names: Module 1, Module 2 (2 total)
    ##   unique identifiers: AFG3L1P, AGAP2-AS1, ..., FLVCR1 (15 total)
    ##   types in collection:
    ##     geneIdType: NullIdentifier (1 total)
    ##     collectionType: NullCollection (1 total)

## 2.8 module_biclust

We Identify gene modules from matched ceRNA and mRNA expression data using a series of biclustering packages, including biclust [28], iBBiG [29], fabia [30], BicARE [31], isa2 [32], s4vd [33], BiBitR [34] and rqubic [35]. The biclustering methods include “BCBimax”, “BCCC”, “BCPlaid”, “BCQuest”, “BCSpectral”, “BCXmotifs”, “iBBiG”, “fabia”, “fabiap”, “fabias”, “mfsc”, “nmfdiv”, “nmfeu”, “nmfsc”, “FLOC”, “isa”, “BCs4vd”, “BCssvd”, “bibit” and “quBicluster”. The default method is “fabia”.

    modulegenes_biclust <- module_biclust(ceRExp[, seq_len(30)],
                                          mRExp[, seq_len(30)])

    ## Cycle: 0
    Cycle: 20
    Cycle: 40
    Cycle: 60
    Cycle: 80
    Cycle: 100
    Cycle: 120
    Cycle: 140
    Cycle: 160
    Cycle: 180
    Cycle: 200
    Cycle: 220
    Cycle: 240
    Cycle: 260
    Cycle: 280
    Cycle: 300
    Cycle: 320
    Cycle: 340
    Cycle: 360
    Cycle: 380
    Cycle: 400
    Cycle: 420
    Cycle: 440
    Cycle: 460
    Cycle: 480
    Cycle: 500

    modulegenes_biclust

    ## GeneSetCollection
    ##   names: Module 1 (1 total)
    ##   unique identifiers: ANKRD36BP2, FN1, ..., ACVR2B-AS1 (6 total)
    ##   types in collection:
    ##     geneIdType: NullIdentifier (1 total)
    ##     collectionType: NullCollection (1 total)

# 3 Identification of miRNA sponge modules

The identified gene modules are regarded as candidate miRNA sponge modules. Based on the candidate miRNA sponge modules, we use the sensitivity canonical correlation (SCC), sensitivity distance correlation (SDC) and sensitivity RV coefficient (SRVC) methods to identify miRNA sponge modules. In addition, we also added the sponge module (SM) method proposed in [36] to predict miRNA sponge modules.

    modulegenes_igraph <- module_igraph(ceRExp[, seq_len(10)],
                                      mRExp[, seq_len(10)])
    # Identify miRNA sponge modules using sensitivity RV coefficient (SRVC)
    miRSM_igraph_SRVC <- miRSM(miRExp, ceRExp, mRExp, miRTarget,
                            modulegenes_igraph,
                            num_shared_miRNAs = 3, pvalue.cutoff = 0.05,
                            method = "SRVC", MC.cutoff = 0.8,
                            SMC.cutoff = 0.01, RV_method = "RV")
    miRSM_igraph_SRVC

    ## [1] "No miRNA sponge modules identified"

# 4 Modular analysis of the identified miRNA sponge modules

## 4.1 Functional analysis of miRNA sponge modules

We implement ‘module_FA’ function to conduct functional analysis of miRNA sponge modules. The functional analysis includes two types: functional enrichment analysis (FEA) and disease enrichment analysis (DEA). Functional enrichment analysis includes GO, KEGG and Reactome enrichment analysis. The ontology databases used contain GO: Gene Ontology database (http://www.geneontology.org/), KEGG: Kyoto Encyclopedia of Genes and Genomes Pathway Database (http://www.genome.jp/kegg/), and Reactome: Reactome Pathway Database (http://reactome.org/). Disease enrichment analysis includes DO, DGN and NCG enrichment analysis. The disease databases used include DO: Disease Ontology database (http://disease-ontology.org/), DGN: DisGeNET database (http://www.disgenet.org/) and NCG: Network of Cancer Genes database (http://ncg.kcl.ac.uk/).

    modulegenes_WGCNA <- module_WGCNA(ceRExp[, seq_len(150)],
                                      mRExp[, seq_len(150)])
    # Identify miRNA sponge modules using sensitivity RV coefficient (SRVC)
    miRSM_WGCNA_SRVC <- miRSM(miRExp, ceRExp, mRExp, miRTarget,
                             modulegenes_WGCNA, method = "SRVC",
                             SMC.cutoff = 0.01, RV_method = "RV")
    miRSM_WGCNA_SRVC_genes <- miRSM_WGCNA_SRVC[[2]]
    miRSM_WGCNA_SRVC_FEA <- module_FA(miRSM_WGCNA_SRVC_genes, Analysis.type = 'FEA')
    miRSM_WGCNA_SRVC_DEA <- module_FA(miRSM_WGCNA_SRVC_genes, Analysis.type = 'DEA')

## 4.2 Cancer enrichment analysis of miRNA sponge modules

To investigate whether the identified miRNA sponge modules are functionally associated with cancer of interest, we implement ‘module_CEA’ function to conduct cancer enrichment analysis by using a hypergeometric test.

    modulegenes_WGCNA <- module_WGCNA(ceRExp[, seq_len(150)],
                                      mRExp[, seq_len(150)])

    ##    Power SFT.R.sq  slope truncated.R.sq mean.k. median.k. max.k.
    ## 1      1   0.0895  0.309         0.1170  98.900  119.0000 155.00
    ## 2      2   0.0596 -0.227         0.2320  50.800   60.6000 105.00
    ## 3      3   0.2130 -0.351         0.2590  30.900   33.1000  78.20
    ## 4      4   0.3920 -0.466         0.2520  20.400   18.8000  60.80
    ## 5      5   0.5420 -0.569         0.4120  14.200   11.0000  48.40
    ## 6      6   0.7680 -0.619         0.7610  10.200    6.6000  39.20
    ## 7      7   0.8130 -0.651         0.8450   7.530    4.0200  32.10
    ## 8      8   0.7970 -0.740         0.8160   5.690    2.4800  26.60
    ## 9      9   0.6740 -0.843         0.6600   4.380    1.5500  22.20
    ## 10    10   0.1650 -1.840         0.0659   3.430    0.9810  18.70
    ## 11    12   0.1760 -1.910         0.0729   2.200    0.4040  13.80
    ## 12    14   0.9700 -0.898         0.9690   1.490    0.1860  10.40
    ## 13    16   0.9630 -0.922         0.9530   1.060    0.0876   8.05
    ## 14    18   0.9490 -0.889         0.9570   0.777    0.0419   6.33
    ## 15    20   0.9310 -0.919         0.9270   0.589    0.0198   5.38
    ## ..connectivity..
    ## ..matrix multiplication (system BLAS)..
    ## ..normalization..
    ## ..done.

    # Identify miRNA sponge modules using sensitivity RV coefficient (SRVC)
    miRSM_WGCNA_SRVC <- miRSM(miRExp, ceRExp, mRExp, miRTarget,
                             modulegenes_WGCNA, method = "SRVC",
                             SMC.cutoff = 0.01, RV_method = "RV")
    miRSM_WGCNA_SRVC_genes <- miRSM_WGCNA_SRVC[[2]]
    miRSM.CEA.pvalue <- module_CEA(ceRExp, mRExp, BRCA_genes, miRSM_WGCNA_SRVC_genes)
    miRSM.CEA.pvalue

    ##   miRSM 1
    ## 0.2835354

## 4.3 Validation of miRNA sponge interactions in miRNA sponge modules

The function ‘module_Validate’ is implemented to validate the miRNA sponge interactions existed in each miRNA sponge module.

    # Using the built-in groundtruth from the miRspongeR package
    library(miRspongeR)
    Groundtruthcsv <- system.file("extdata", "Groundtruth.csv", package="miRspongeR")
    Groundtruth <- read.csv(Groundtruthcsv, header=TRUE, sep=",")
    # Using the identified miRNA sponge modules based on WGCNA and sensitivity RV coefficient (SRVC)
    miRSM.Validate <- module_Validate(miRSM_WGCNA_SRVC_genes, Groundtruth)

## 4.4 Co-expression analysis of miRNA sponge modules

To evaluate whether the ceRNAs and mRNAs in the miRNA sponge modules are not randomly co-expressed, we implement ‘module_Coexpress’ function calculate average (mean and median) absolute Pearson correlation of all the ceRNA-mRNA pairs in each miRNA sponge module to see the overall co-expression level between the ceRNAs and mRNAs in the miRNA sponge module. For each miRNA sponge module, we perform a permutation test by generating random modules (the parameter ‘resample’ is the number of random modules to be generated) with the same number of ceRNAs and mRNAs for it to compute the statistical significance p-value of the co-expression level.

    # Using the identified miRNA sponge modules based on WGCNA and sensitivity RV coefficient (SRVC)
    miRSM_WGCNA_Coexpress <-  module_Coexpress(ceRExp, mRExp, miRSM_WGCNA_SRVC_genes, resample = 10, method = "mean", test.method = "t.test")
    miRSM_WGCNA_Coexpress

    ## $`Real miRNA sponge modules`
    ## [1] 0.7512547
    ##
    ## $`Random miRNA sponge modules`
    ## [1] 0.2232512
    ##
    ## $`Statistical significance p-value`
    ## [1] 1.008359e-10

## 4.5 miRNA distribution analysis of sharing miRNAs

To investigate the distribution of sharing miRNAs in the identified miRNA sponge modules, we implement ‘module_miRdistribute’ function. The miRNA distribution analysis can understand whether the sharing miRNAs act as crosslinks across different miRNA sponge modules.

    # Using the identified miRNA sponge modules based on WGCNA and sensitivity RV coefficient (SRVC)
    miRSM_WGCNA_share_miRs <-  share_miRs(miRExp, ceRExp, mRExp, miRTarget, miRSM_WGCNA_SRVC_genes)
    miRSM_WGCNA_miRdistribute <- module_miRdistribute(miRSM_WGCNA_share_miRs)
    head(miRSM_WGCNA_miRdistribute)

    ##      miRNA             Module ID Number of modules
    ## [1,] "hsa-let-7b-5p"   "miRSM 1" "1"
    ## [2,] "hsa-let-7d-5p"   "miRSM 1" "1"
    ## [3,] "hsa-let-7e-5p"   "miRSM 1" "1"
    ## [4,] "hsa-miR-125a-5p" "miRSM 1" "1"
    ## [5,] "hsa-miR-148b-3p" "miRSM 1" "1"
    ## [6,] "hsa-miR-149-5p"  "miRSM 1" "1"

## 4.6 Predict miRNA-target interactions

Since the identified miRNA sponge modules and their sharing miRNAs can also be used to predict miRNA-target interactions (including miRNA-ceRNA and miRNA-mRNA interactions), we implement ‘module_miRtarget’ function to predict miRNA-target interactions underlying in each miRNA sponge module.

    # Using the identified miRNA sponge modules based on WGCNA and sensitivity RV coefficient (SRVC)
    miRSM_WGCNA_miRtarget <- module_miRtarget(miRSM_WGCNA_share_miRs, miRSM_WGCNA_SRVC_genes)

## 4.7 Identify miRNA sponge interactions

To extract miRNA sponge interactions of each miRNA sponge module, we implement ‘module_miRsponge’ function to identify miRNA sponge interactions.

    # Using the identified miRNA sponge modules based on WGCNA and sensitivity RV coefficient (SRVC)
    miRSM_WGCNA_miRsponge <- module_miRsponge(ceRExp, mRExp, miRSM_WGCNA_SRVC_genes)

# 5 Conclusions

miRSM provides several functions to study miRNA sponge modules, including popular methods for inferring gene modules (candidate miRNA sponge modules), and a function to identify miRNA sponge modules, as well as several functions to conduct modular analysis of miRNA sponge modules. It could provide a useful tool for the research of miRNA sponge modules.

# 6 References

[1] Ambros V. microRNAs: tiny regulators with great potential. Cell, 2001, 107:823–6.

[2] Bartel DP. MicroRNAs: genomics, biogenesis, mechanism, and function. Cell, 2004, 116:281–97.

[3] Du T, Zamore PD. Beginning to understand microRNA function. Cell Research, 2007, 17:661–3.

[4] Esquela-Kerscher A, Slack FJ. Oncomirs—microRNAs with a role in cancer. Nature Reviews Cancer, 2006, 6:259–69.

[5] Lin S, Gregory RI. MicroRNA biogenesis pathways in cancer. Nature Reviews Cancer, 2015, 15:321–33.

[6] Cesana M, Cacchiarelli D, Legnini I, et al. A long noncoding RNA controls muscle differentiation by functioning as a competing endogenous RNA. Cell, 2011, 147:358–69.

[7] Poliseno L, Salmena L, Zhang J, et al. A coding-independent function of gene and pseudogene mRNAs regulates tumour biology. Nature, 2010, 465:1033–8.

[8] Hansen TB, Jensen TI, Clausen BH, et al. Natural RNA circles function as efficient microRNA sponges. Nature, 2013, 495:384–8.

[9] Memczak S, Jens M, Elefsinioti A, et al. Circular RNAs are a large class of animal RNAs with regulatory potency. Nature, 2013, 495:333–8.

[10] Salmena L, Poliseno L, Tay Y, et al. A ceRNA hypothesis: the Rosetta Stone of a hidden RNA language? Cell, 2011, 146(3):353-8.

[11] Langfelder P, Horvath S. WGCNA: an R package for weighted correlation network analysis. BMC Bioinformatics, 2008, 9:559.

[12] Bunte K, Lepp"{a}aho E, Saarinen I, Kaski S. Sparse group factor analysis for biclustering of multiple data sources. Bioinformatics, 2016, 32(16):2457-63.

[13] Lepp"{a}aho E, Ammad-ud-din M, Kaski S. GFA: exploratory analysis of multiple data sources with group factor analysis. J Mach Learn Res., 2017, 18(39):1-5.

[14] Csardi G, Nepusz T. The igraph software package for complex network research, InterJournal, Complex Systems, 2006:1695.

[15] Clauset A, Newman ME, Moore C. Finding community structure in very large networks. Phys Rev E Stat Nonlin Soft Matter Phys., 2004, 70(6 Pt 2):066111.

[16] Enright AJ, Van Dongen S, Ouzounis CA. An efficient algorithm for large-scale detection of protein families. Nucleic Acids Res., 2002, 30(7):1575-84.

[17] Kalinka AT, Tomancak P. linkcomm: an R package for the generation, visualization, and analysis of link communities in networks of arbitrary size and type. Bioinformatics, 2011, 27(14):2011-2.

[18] Bader GD, Hogue CW. An automated method for finding molecular complexes in large protein interaction networks. BMC Bioinformatics, 2003, 4:2.

[19] Zhang Y, Phillips CA, Rogers GL, Baker EJ, Chesler EJ, Langston MA. On finding bicliques in bipartite graphs: a novel algorithm and its application to the integration of diverse biological data types. BMC Bioinformatics, 2014, 15:110.

[20] Gaujoux R, Seoighe C. A flexible R package for nonnegative matrix factorization. BMC Bioinformatics, 2010, 11:367.

[21] R Core Team. R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria, 2018.

[22] Langfelder P, Horvath S. Fast R Functions for Robust Correlations and Hierarchical Clustering. Journal of Statistical Software. 2012, 46(11):1-17.

[23] Hahsler M, Piekenbrock M. dbscan: Density Based Clustering of Applications with Noise (DBSCAN) and Related Algorithms. R package version 1.1-2, 2018.

[24] Cebeci Z, Yildiz F, Kavlak AT, Cebeci C, Onder H. ppclust: Probabilistic and Possibilistic Cluster Analysis. R package version 0.1.1, 2018.

[25] Scrucca L, Fop M, Murphy TB, Raftery AE. mclust 5: clustering, classification and density estimation using Gaussian finite mixture models The R Journal 8/1, 2016, pp. 205-233.

[26] Villa-Vialaneix N, Bendhaiba L, Olteanu M. SOMbrero: SOM Bound to Realize Euclidean and Relational Outputs. R package version 1.2-3, 2018.

[27] Cebeci Z, Yildiz F, Kavlak AT, Cebeci C, Onder H. ppclust: Probabilistic and Possibilistic Cluster Analysis. R package version 0.1.2, 2019.

[28] Kaiser S, Santamaria R, Khamiakova T, Sill M, Theron R, Quintales L, Leisch F, De TE. biclust: BiCluster Algorithms. R package version 1.2.0., 2015.

[29] Gusenleitner D, Howe EA, Bentink S, Quackenbush J, Culhane AC. iBBiG: iterative binary bi-clustering of gene sets. Bioinformatics, 2012, 28(19):2484-92.

[30] Hochreiter S, Bodenhofer U, Heusel M, Mayr A, Mitterecker A, Kasim A, Khamiakova T, Van Sanden S, Lin D, Talloen W, Bijnens L, G"{o}hlmann HW, Shkedy Z, Clevert DA. FABIA: factor analysis for bicluster acquisition. Bioinformatics, 2010, 26(12):1520-7.

[31] Yang J, Wang H, Wang W, Yu, PS. An improved biclustering method for analyzing gene expression. Int J Artif Intell Tools, 2005, 14(5): 771-789.

[32] Bergmann S, Ihmels J, Barkai N. Iterative signature algorithm for the analysis of large-scale gene expression data. Phys Rev E Stat Nonlin Soft Matter Phys., 2003, 67(3 Pt 1):031902.

[33] Sill M, Kaiser S, Benner A, Kopp-Schneider A. Robust biclustering by sparse singular value decomposition incorporating stability selection. Bioinformatics, 2011, 27(15):2089-97.

[34] Rodriguez-Baena DS, Perez-Pulido AJ, Aguilar-Ruiz JS. A biclustering algorithm for extracting bit-patterns from binary datasets. Bioinformatics, 2011, 27(19):2738-45.

[35] Li G, Ma Q, Tang H, Paterson AH, Xu Y. QUBIC: a qualitative biclustering algorithm for analyses of gene expression data. Nucleic Acids Res., 2009, 37(15):e101.

[36] Zhang J, Le TD, Liu L, Li J. Identifying miRNA sponge modules using biclustering and regulatory scores.BMC Bioinformatics, 2017, 18(Suppl 3):44.

# 7 Session information

    sessionInfo()

    ## R version 4.1.0 (2021-05-18)
    ## Platform: x86_64-pc-linux-gnu (64-bit)
    ## Running under: Ubuntu 20.04.2 LTS
    ##
    ## Matrix products: default
    ## BLAS:   /home/biocbuild/bbs-3.13-bioc/R/lib/libRblas.so
    ## LAPACK: /home/biocbuild/bbs-3.13-bioc/R/lib/libRlapack.so
    ##
    ## locale:
    ##  [1] LC_CTYPE=en_US.UTF-8          LC_NUMERIC=C
    ##  [3] LC_TIME=en_GB                 LC_COLLATE=C
    ##  [5] LC_MONETARY=en_US.UTF-8       LC_MESSAGES=en_US.UTF-8
    ##  [7] LC_PAPER=en_US.UTF-8          LC_NAME=en_US.UTF-8
    ##  [9] LC_ADDRESS=en_US.UTF-8        LC_TELEPHONE=en_US.UTF-8
    ## [11] LC_MEASUREMENT=en_US.UTF-8    LC_IDENTIFICATION=en_US.UTF-8
    ##
    ## attached base packages:
    ## [1] parallel  stats     graphics  grDevices utils     datasets  methods
    ## [8] base
    ##
    ## other attached packages:
    ##  [1] NMF_0.23.0          cluster_2.1.2       rngtools_1.5
    ##  [4] pkgmaker_0.32.2     registry_0.5-1      miRSM_1.10.0
    ##  [7] bigmemory_4.5.36    Biobase_2.52.0      BiocGenerics_0.38.0
    ## [10] BiocStyle_2.20.0
    ##
    ## loaded via a namespace (and not attached):
    ##   [1] rappdirs_0.3.3              tidyr_1.1.3
    ##   [3] ggplot2_3.3.3               bit64_4.0.5
    ##   [5] knitr_1.33                  irlba_2.3.3
    ##   [7] DelayedArray_0.18.0         data.table_1.14.0
    ##   [9] rpart_4.1-15                KEGGREST_1.32.0
    ##  [11] RCurl_1.98-1.3              doParallel_1.0.16
    ##  [13] generics_0.1.0              preprocessCore_1.54.0
    ##  [15] cowplot_1.1.1               RSQLite_2.2.7
    ##  [17] shadowtext_0.0.8            bit_4.0.4
    ##  [19] enrichplot_1.12.0           httpuv_1.6.1
    ##  [21] lubridate_1.7.10            SummarizedExperiment_1.22.0
    ##  [23] assertthat_0.2.1            viridis_0.6.1
    ##  [25] xfun_0.23                   rJava_1.0-4
    ##  [27] hms_1.1.0                   jquerylib_0.1.4
    ##  [29] promises_1.2.0.1            evaluate_0.14
    ##  [31] additivityTests_1.1-4       fansi_0.4.2
    ##  [33] progress_1.2.2              dendextend_1.15.1
    ##  [35] igraph_1.2.6                DBI_1.1.1
    ##  [37] htmlwidgets_1.5.3           stats4_4.1.0
    ##  [39] purrr_0.3.4                 ellipsis_0.3.2
    ##  [41] RSpectra_0.16-0             dplyr_1.0.6
    ##  [43] backports_1.2.1             energy_1.7-8
    ##  [45] isa2_0.3.5                  V8_3.4.2
    ##  [47] bookdown_0.22               ppclust_1.1.0
    ##  [49] markdown_1.1                metR_0.9.1
    ##  [51] annotate_1.70.0             linkcomm_1.0-14
    ##  [53] gridBase_0.4-7              deldir_0.2-10
    ##  [55] MatrixGenerics_1.4.0        vctrs_0.3.8
    ##  [57] ggwordcloud_0.5.0           cachem_1.0.5
    ##  [59] withr_2.4.2                 ggforce_0.3.3
    ##  [61] checkmate_2.0.0             treeio_1.16.0
    ##  [63] prettyunits_1.1.1           mclust_5.4.7
    ##  [65] DOSE_3.18.0                 GFA_1.0.3
    ##  [67] gsl_2.1-6                   ape_5.5
    ##  [69] lazyeval_0.2.2              crayon_1.4.1
    ##  [71] varhandle_2.0.5             pkgconfig_2.0.3
    ##  [73] tweenr_1.0.2                GenomeInfoDb_1.28.0
    ##  [75] nlme_3.1-152                nnet_7.3-16
    ##  [77] rlang_0.4.11                lifecycle_1.0.0
    ##  [79] downloader_0.4              bigmemory.sri_0.1.3
    ##  [81] dbscan_1.1-8                polyclip_1.10-0
    ##  [83] matrixStats_0.58.0          SOMbrero_1.3-1
    ##  [85] graph_1.70.0                Matrix_1.3-3
    ##  [87] aplot_0.0.6                 boot_1.3-28
    ##  [89] base64enc_0.1-3             PMA_1.2.1
    ##  [91] png_0.1-7                   viridisLite_0.4.0
    ##  [93] bitops_1.0-7                Biostrings_2.60.0
    ##  [95] iBBiG_1.36.0                blob_1.2.1
    ##  [97] stringr_1.4.0               BicARE_1.50.0
    ##  [99] qvalue_2.24.0               ggvis_0.4.7
    ## [101] jpeg_0.1-8.1                BiBitR_0.3.1
    ## [103] S4Vectors_0.30.0            reactome.db_1.76.0
    ## [105] scales_1.1.1                graphite_1.38.0
    ## [107] memoise_2.0.0               GSEABase_1.54.0
    ## [109] magrittr_2.0.1              plyr_1.8.6
    ## [111] inaparc_1.1.0               zlibbioc_1.38.0
    ## [113] compiler_4.1.0              scatterpie_0.1.6
    ## [115] RColorBrewer_1.1-2          plotrix_3.8-1
    ## [117] ade4_1.7-16                 XVector_0.32.0
    ## [119] patchwork_1.1.1             htmlTable_2.2.1
    ## [121] Formula_1.2-4               MASS_7.3-54
    ## [123] WGCNA_1.70-3                tidyselect_1.1.1
    ## [125] stringi_1.6.2               kpeaks_1.1.0
    ## [127] MatrixCorrelation_0.9.5     yaml_2.2.1
    ## [129] GOSemSim_2.18.0             latticeExtra_0.6-29
    ## [131] ggrepel_0.9.1               grid_4.1.0
    ## [133] sass_0.4.0                  fastmatch_1.1-0
    ## [135] randomcoloR_1.1.0.1         tools_4.1.0
    ## [137] rstudioapi_0.13             foreach_1.5.1
    ## [139] foreign_0.8-81              gridExtra_2.3
    ## [141] scatterplot3d_0.3-41        farver_2.1.0
    ## [143] Rtsne_0.15                  ggraph_2.0.5
    ## [145] digest_0.6.27               rvcheck_0.1.8
    ## [147] BiocManager_1.30.15         shiny_1.6.0
    ## [149] pracma_2.3.3                flexclust_1.4-0
    ## [151] Rcpp_1.0.6                  GenomicRanges_1.44.0
    ## [153] later_1.2.0                 org.Hs.eg.db_3.13.0
    ## [155] httr_1.4.2                  AnnotationDbi_1.54.0
    ## [157] colorspace_2.0-1            biclust_2.0.2
    ## [159] XML_3.99-0.6                IRanges_2.26.0
    ## [161] splines_4.1.0               tidytree_0.3.3
    ## [163] expm_0.999-6                graphlayouts_0.7.1
    ## [165] MCL_1.0                     xtable_1.8-4
    ## [167] jsonlite_1.7.2              ggtree_3.0.0
    ## [169] dynamicTreeCut_1.63-1       tidygraph_1.2.0
    ## [171] corpcor_1.6.9               flashClust_1.01-2
    ## [173] modeltools_0.2-23           fabia_2.38.0
    ## [175] subspace_1.0.4              R6_2.5.0
    ## [177] lhs_1.1.1                   Hmisc_4.5-0
    ## [179] mime_0.10                   pillar_1.6.1
    ## [181] htmltools_0.5.1.1           glue_1.4.2
    ## [183] fastmap_1.1.0               clusterProfiler_4.0.0
    ## [185] BiocParallel_1.26.0         rqubic_1.38.0
    ## [187] class_7.3-19                codetools_0.2-18
    ## [189] fgsea_1.18.0                utf8_1.2.1
    ## [191] lattice_0.20-44             bslib_0.2.5.1
    ## [193] tibble_3.1.2                s4vd_1.1-1
    ## [195] curl_4.3.1                  miRspongeR_1.18.0
    ## [197] ReactomePA_1.36.0           GO.db_3.13.0
    ## [199] interp_1.0-33               survival_3.2-11
    ## [201] rmarkdown_2.8               munsell_0.5.0
    ## [203] DO.db_2.9                   fastcluster_1.1.25
    ## [205] GenomeInfoDbData_1.2.6      iterators_1.0.13
    ## [207] impute_1.66.0               reshape2_1.4.4
    ## [209] gtable_0.3.0