Maximum rectilinear convex subsets
Hernán González-Aguilar, David Orden, Pablo Pérez-Lantero, David Rappaport, Carlos Seara, Javier Tejel, Jorge Urrutia
TL;DR
This work provides efficient $O(n^3)$-time, $O(n^2)$-space algorithms for maximizing the size, area, or weight of rectilinear convex hulls induced by a subset of a point set under rectilinear (orthoconvex) constraints. It introduces a cohesive framework built on four-separator geometry and staircase decompositions to solve MaxRCH and its variants, and extends these techniques to related problems such as MaxOrthoconvexPolygon and MaxStaircasePolygon with matching asymptotic performance. The results unify multiple Erdős-Szekeres-type problems in the rectilinear setting, offering simpler, interchangeable dynamic-programming formulations and practical preprocessing for constant-time rectangle queries. The methods have potential applications in VLSI layout, visibility, and related geometric optimization tasks where axis-aligned convexity governs feasibility and performance.
Abstract
Let $P$ be a set of $n$ points in the plane. We consider a variation of the classical Erdős-Szekeres problem, presenting efficient algorithms with $O(n^3)$ running time and $O(n^2)$ space complexity that compute: (1) A subset $S$ of $P$ such that the boundary of the rectilinear convex hull of $S$ has the maximum number of points from $P$, (2) a subset $S$ of $P$ such that the boundary of the rectilinear convex hull of $S$ has the maximum number of points from $P$ and its interior contains no element of $P$, (3) a subset $S$ of $P$ such that the rectilinear convex hull of $S$ has maximum area and its interior contains no element of $P$, and (4) when each point of $P$ is assigned a weight, positive or negative, a subset $S$ of $P$ that maximizes the total weight of the points in the rectilinear convex hull of $S$. We also revisit the problems of computing a maximum-area orthoconvex polygon and computing a maximum-area staircase polygon, amidst a point set in a rectangular domain. We obtain new and simpler algorithms to solve both problems with the same complexity as in the state of the art.
