A parallel cell-based filtering scheme for indexing high-dimensional vector

  • Seungtae Hong*
  • , Jihee Kim
  • , Jungho Um
  • , Jaewoo Chang
  • *Corresponding author for this work

    Research output: Contribution to conferenceConference paperpeer-review

    Abstract

    Many high-dimensional index structures have been proposed, but they suffer from the so called 'dimensional curse' problem, i.e., the retrieval performance becomes increasingly degraded as the dimensionality is increased. To solve this problem, the cell-based filtering (CBF) scheme has been proposed, but it shows a linear decrease in performance as the dimensionality is increased. In this paper, we propose a parallel CBF scheme for indexing high-dimensional vector data, so as to cope with the linear decrease in retrieval performance. In addition, we devise data insertion, range query and k-NN query processing algorithms which are suitable for a parallel architecture. Finally, we show that our parallel CBF scheme achieves good retrieval performance in proportion to the number of servers in the parallel architecture and it outperforms a parallel version of the VA- File when the dimensionality is over 10.

    Original languageEnglish
    Title of host publicationProceedings of the 2008 International Conference on Parallel and Distributed Processing Techniques and Applications, PDPTA 2008
    Pages384-389
    Number of pages6
    StatePublished - 2008
    Event2008 International Conference on Parallel and Distributed Processing Techniques and Applications, PDPTA 2008 - Las Vegas, NV, United States
    Duration: 2008.07.142008.07.17

    Publication series

    NameProceedings of the 2008 International Conference on Parallel and Distributed Processing Techniques and Applications, PDPTA 2008

    Conference

    Conference2008 International Conference on Parallel and Distributed Processing Techniques and Applications, PDPTA 2008
    Country/TerritoryUnited States
    CityLas Vegas, NV
    Period08.07.1408.07.17

    Keywords

    • Cell-based filtering scheme
    • High-dimensional vector data
    • Parallel index structure

    Quacquarelli Symonds(QS) Subject Topics

    • Computer Science & Information Systems
    • Engineering - Electrical & Electronic
    • Engineering - Petroleum
    • Data Science

    Fingerprint

    Dive into the research topics of 'A parallel cell-based filtering scheme for indexing high-dimensional vector'. Together they form a unique fingerprint.

    Cite this