cpark::PartitionByRdd< R, Partitioner > Class Template Reference

#include <partition_by_rdd.h>

Inheritance diagram for cpark::PartitionByRdd< R, Partitioner >:

Public Types
using	Base = BaseRdd< PartitionByRdd< R, Partitioner > >

Public Member Functions
	PartitionByRdd (const R &prev, Partitioner partitioner)
	PartitionByRdd (const R &prev)
	PartitionByRdd (const PartitionByRdd &)=default
PartitionByRdd &	operator= (const PartitionByRdd &)=default

Public Attributes
friend	Base

Detailed Description

template<concepts::KeyValueRdd R, typename Partitioner = std::hash<utils::RddKeyType<R>>>
class cpark::PartitionByRdd< R, Partitioner >

Re-partition an Rdd of key-value pairs using a partitioner function into new splits.

Template Parameters

R	Original Rdd. Its elements must be of key-value type (pair-like).
Partitioner	A partitioner function mapping the key-type to a size_t. Each element in the Rdd whose key is mapped to i will be assigned to the i % split_num-th split in the new Rdd.

Constructor & Destructor Documentation

PartitionByRdd() [1/3]

template<concepts::KeyValueRdd R, typename Partitioner = std::hash<utils::RddKeyType<R>>>

cpark::PartitionByRdd< R, Partitioner >::PartitionByRdd ( const R &  prev, Partitioner  partitioner  )

inline

Creates a PartitionByRdd based on an old Rdd prev, using the partition function partitioner.

PartitionByRdd() [2/3]

template<concepts::KeyValueRdd R, typename Partitioner = std::hash<utils::RddKeyType<R>>>

cpark::PartitionByRdd< R, Partitioner >::PartitionByRdd ( const R &  prev )

inlineexplicit

Creates a PartitionByRdd based on an old Rdd prev, using the default partitioner function std::hash{}.

PartitionByRdd() [3/3]

template<concepts::KeyValueRdd R, typename Partitioner = std::hash<utils::RddKeyType<R>>>

cpark::PartitionByRdd< R, Partitioner >::PartitionByRdd ( const PartitionByRdd< R, Partitioner > &  )

default

Add default constructors to avoid some liter errors.

---

The documentation for this class was generated from the following file:

• include/partition_by_rdd.h