Developer profile

Hyukjin Kwon

@hyukjinkwon on GitHub ↗

@Apache @Databricks · South Korea

Likely Available

About

Comments from this profile are opinions of the profile owner. ASF member, Apache Spark PMC member and committer @apache Staff Software Engineer @databricks

Repositories

spark-connect-ruby

A pure-Ruby client for Apache Spark Connect: a PySpark-style DataFrame API over gRPC.

Ruby★ 4⑂ 1

pyspark-client-wasm

PySpark in JupyterLite: run the real PySpark Connect client in the browser over grpc-web

Python★ 3⑂ 0

spark-memory-shuffle

In-memory ShuffleManager plugin for Apache Spark 4.2.0 (memory-to-memory shuffle with disk spill)

Scala★ 2⑂ 0

elementwise-udf

A PySpark Python UDF that works inside Spark's native higher-order functions (transform, filter, aggregate, array_sort, ...)

Python★ 2⑂ 0

spark-connect-scala3

A native Apache Spark Connect client for Scala 3: SparkSession/DataFrame/Column/functions API over gRPC.

Scala★ 2⑂ 0

spark-connect-excel

Run Spark SQL against your own Spark Connect cluster from Excel - results land in a range, refreshable and chartable, with no backend server (powered by pyspark-connect-web).

TypeScript★ 2⑂ 0

adbc-driver-spark

Apache Arrow ADBC driver for Apache Spark Connect (Go core, C-ABI shared library, Python DBAPI). Arrow-native, multi-language.

Go★ 1⑂ 0

spark

Mirror of Apache Spark

Scala★ 1⑂ 6

HyukjinKwon.github.io

Personal homepage for Hyukjin Kwon — static site with GitHub Pages

Python★ 1⑂ 0