有没有办法从图像中提取扭曲的矩形/正方形？

Question

这是图像，我想填充这个矩形或正方形的边缘，这样我就可以使用轮廓裁剪它。到目前为止，我所做的是，我使用canny边缘检测器查找边缘，然后使用按位_或我将这个矩形填充一点，但不是完全填充。如何填充这个矩形，或者有没有直接裁剪的方法？

image = cv2.imread('C:/Users/hp/Desktop/segmentation/test3.jpeg')

img3 = img2 = image.copy()
image = cv2.cvtColor(image, cv2.COLOR_BGR2HSV)
img3 = cv2.cvtColor(img2,cv2.COLOR_BGR2GRAY)

lower = np.array([155,25,0])
upper = np.array([179,255,255])
mask = cv2.inRange(image, lower, upper)

edges = cv2.Canny(mask, 1, 255, apertureSize=7)
result = cv2.bitwise_or(edges, mask)

Answer 1

下面是在Python/OpenCV中提取矩形白色像素边界的一种方法。

• 读取输入
• 转换为灰色
• 阈值
• 做Canny边缘检测
• 获取霍夫线段，并在黑色背景上绘制为白色
• 获取白色像素的边界
• 裁剪输入到边界

输入：

import cv2
import numpy as np

# load image as grayscale
img = cv2.imread('rect_lines.jpg')

gray = cv2.cvtColor(img, cv2.COLOR_BGR2GRAY)

# threshold 
thresh = cv2.threshold(gray, 0, 255, cv2.THRESH_BINARY)[1]

# apply canny edge detection
edges = cv2.Canny(thresh, 100, 200)

# get hough line segments
threshold = 100
minLineLength = 50
maxLineGap = 20
lines = cv2.HoughLinesP(thresh, 1, np.pi/360, threshold, minLineLength, maxLineGap)

# draw lines
linear = np.zeros_like(thresh)
for [line] in lines:
    #print(line)
    x1 = line[0]
    y1 = line[1]
    x2 = line[2]
    y2 = line[3]
    cv2.line(linear, (x1,y1), (x2,y2), (255), 1)

# get bounds of white pixels
white = np.where(linear==255)
xmin, ymin, xmax, ymax = np.min(white[1]), np.min(white[0]), np.max(white[1]), np.max(white[0])
#print(xmin,xmax,ymin,ymax)

# draw bounding box on input
bounds = img.copy()
cv2.rectangle(bounds, (xmin,ymin), (xmax,ymax), (0,0,255))

# crop the image at the bounds
crop = img[ymin:ymax, xmin:xmax]

# save resulting masked image
cv2.imwrite('rect_lines_edges.png', edges)
cv2.imwrite('rect_lines_hough.png', linear)
cv2.imwrite('rect_lines_bounds.png', bounds)
cv2.imwrite('rect_lines_crop.png', crop)

# display result, though it won't show transparency
cv2.imshow("thresh", thresh)
cv2.imshow("edges", edges)
cv2.imshow("lines", linear)
cv2.imshow("bounds", bounds)
cv2.imshow("crop", crop)
cv2.waitKey(0)
cv2.destroyAllWindows()

精明的边缘：

Hough线段：

输入时的边界框：

裁剪图像：