Algolia search crawler is finding 301/302 redirect pages

[randypacker]

Our search crawler is finding links that lead to 301/302 redirects, and therefore some pages may not be getting updated during regular crawl updates.

Most of these redirects are occuring due to either a double "//" in the url path, and/or a lack of a trailing "/" in the url path. Currently the links that are 301/302 are the following:

https://docs.openmoonray.org//developer-reference/shaders/normal-maps
https://docs.openmoonray.org//developer-reference/shaders/materials
https://docs.openmoonray.org//developer-reference/shaders/maps
https://docs.openmoonray.org//developer-reference/shaders/volume-shaders
https://docs.openmoonray.org//developer-reference/shaders/display-filters
https://docs.openmoonray.org//developer-reference/shaders/lights
https://docs.openmoonray.org//developer-reference/shaders/cameras
https://docs.openmoonray.org//developer-reference/shaders/light-filters
https://docs.openmoonray.org//developer-reference/shaders/geometry-procedurals
https://docs.openmoonray.org//developer-reference/shaders/displacement
https://docs.openmoonray.org/user-reference/tools/hydra/hd_render
https://docs.openmoonray.org/user-reference/tools/hydra/render-settings
https://docs.openmoonray.org/user-reference/tools/moonray-gui
https://docs.openmoonray.org/user-reference/tools/moonray
https://docs.openmoonray.org/user-reference/tools/hydra/hdmoonray-features
https://docs.openmoonray.org/user-reference/tools/hydra/hdmoonray-setup
https://docs.openmoonray.org/getting-started/about/moonray
https://docs.openmoonray.org/user-reference/tools/arras_render
https://docs.openmoonray.org/getting-started/moonray-widget-license
https://docs.openmoonray.org/developer-reference/coding-standards
https://docs.openmoonray.org/getting-started/moonray-sphere-usd-license
https://docs.openmoonray.org/user-reference/tools/rdl2_convert
https://docs.openmoonray.org/getting-started/installation/building-moonray/rocky9_container_build
https://docs.openmoonray.org/getting-started/installation/building-moonray/rocky9_build
https://docs.openmoonray.org/user-reference/how-to-guides/motion-blur
https://docs.openmoonray.org/user-reference/how-to-guides/point-rendering
https://docs.openmoonray.org/getting-started/installation/building-moonray/general_build
https://docs.openmoonray.org/developer-reference/shaders/geometry-procedurals
https://docs.openmoonray.org/getting-started/installation/building-moonray/repo_deps
https://docs.openmoonray.org/user-reference/scene-objects/user-data/UserData
https://docs.openmoonray.org/user-reference/scene-objects/trace-set/TraceSet
https://docs.openmoonray.org/getting-started/installation/building-moonray
https://docs.openmoonray.org/getting-started/installation/building-moonray/centos7_build
https://docs.openmoonray.org/getting-started/installation/cloning-the-repo
https://docs.openmoonray.org/getting-started/installation/building-moonray/centos7_container_build
https://docs.openmoonray.org/user-reference/scene-objects/normal-maps
https://docs.openmoonray.org/user-reference/scene-objects/light-filter-set/LightFilterSet
https://docs.openmoonray.org/user-reference/scene-objects/render-output/RenderOutput
https://docs.openmoonray.org/user-reference/scene-objects/light-set/LightSet
https://docs.openmoonray.org/user-reference/scene-objects/shadow-set/ShadowSet
https://docs.openmoonray.org/user-reference/scene-objects/meta-data/Metadata
https://docs.openmoonray.org/user-reference/scene-objects/shadow-receiver-set/ShadowReceiverSet
https://docs.openmoonray.org/user-reference/scene-objects/scene-variables/SceneVariables
https://docs.openmoonray.org/user-reference/scene-objects/cameras/BakeCamera
https://docs.openmoonray.org/user-reference/scene-objects/normal-maps/ImageNormalMap
https://docs.openmoonray.org/user-reference/scene-objects/cameras/SphericalCamera
https://docs.openmoonray.org/user-reference/how-to-guides/render-outputs/visibility-aovs
https://docs.openmoonray.org/user-reference/scene-objects/cameras/OrthographicCamera
https://docs.openmoonray.org/user-reference/how-to-guides/render-outputs/variance-aovs
https://docs.openmoonray.org/user-reference/scene-objects/layer/Layer
https://docs.openmoonray.org/user-reference/scene-objects/maps/ImageMap
https://docs.openmoonray.org/user-reference/how-to-guides/render-outputs/motion-vectors
https://docs.openmoonray.org/user-reference/how-to-guides/render-outputs/cryptomatte
https://docs.openmoonray.org/user-reference/scene-objects/geometry
https://docs.openmoonray.org/user-reference/tools/render-profile-viewer
https://docs.openmoonray.org/user-reference/scene-objects/volumes/VdbVolume
https://docs.openmoonray.org/user-reference/scene-objects/geometry/RdlMeshGeometry
https://docs.openmoonray.org/user-reference/how-to-guides/render-outputs/material-aovs
https://docs.openmoonray.org/user-reference/scene-objects/geometry/RdlPointGeometry
https://docs.openmoonray.org/user-reference/scene-objects/maps/OpMap
https://docs.openmoonray.org/user-reference/scene-objects/geometry/RdlCurveGeometry
https://docs.openmoonray.org/user-reference/scene-objects/maps/TransformSpaceMap
https://docs.openmoonray.org/user-reference/scene-objects/displacement/NormalDisplacement
https://docs.openmoonray.org/user-reference/scene-objects/cameras/PerspectiveCamera
https://docs.openmoonray.org/user-reference/scene-objects/displacement/CombineDisplacement
https://docs.openmoonray.org/user-reference/scene-objects/displacement/VectorDisplacement
https://docs.openmoonray.org/user-reference/scene-objects/maps/ColorCorrectHsvMap
https://docs.openmoonray.org/user-reference/scene-objects/maps/ColorCorrectGammaMap
https://docs.openmoonray.org/user-reference/scene-objects/maps/ColorCorrectMap
https://docs.openmoonray.org/user-reference/scene-objects/maps/ColorCorrectHueShiftMap
https://docs.openmoonray.org/user-reference/scene-objects/maps/ColorCorrectSaturationMap
https://docs.openmoonray.org/user-reference/scene-objects/maps/ColorCorrectNukeMap
https://docs.openmoonray.org/user-reference/scene-objects/maps/ColorCorrectLegacyMap
https://docs.openmoonray.org/user-reference/scene-objects/maps/AttributeMap
https://docs.openmoonray.org/user-reference/scene-objects/maps/CheckerboardMap
https://docs.openmoonray.org/user-reference/scene-objects/maps/BlendMap
https://docs.openmoonray.org/user-reference/scene-objects/maps/AxisAngleMap
https://docs.openmoonray.org/user-reference/scene-objects/maps/ColorCorrectGainOffsetMap
https://docs.openmoonray.org/developer-reference/shaders/maps
https://docs.openmoonray.org/user-reference/scene-objects/maps/ColorCorrectContrastMap
https://docs.openmoonray.org/user-reference/scene-objects/maps/ClampMap
https://docs.openmoonray.org/user-reference/scene-objects/maps/UsdTransform2d
https://docs.openmoonray.org/user-reference/scene-objects/maps/UsdPrimvarReader_int
https://docs.openmoonray.org/user-reference/scene-objects/maps/UsdPrimvarReader_vector
https://docs.openmoonray.org/user-reference/scene-objects/maps/UsdPrimvarReader_point
https://docs.openmoonray.org/user-reference/scene-objects/maps/UsdUVTexture
https://docs.openmoonray.org/user-reference/scene-objects/maps/WireframeMap
https://docs.openmoonray.org/user-reference/scene-objects/maps/UsdPrimvarReader_normal
https://docs.openmoonray.org/user-reference/scene-objects/maps/SwitchColorMap
https://docs.openmoonray.org/user-reference/scene-objects/maps/RgbToLabMap
https://docs.openmoonray.org/user-reference/scene-objects/maps/UsdPrimvarReader_float3
https://docs.openmoonray.org/user-reference/scene-objects/maps/UVTransformMap
https://docs.openmoonray.org/user-reference/scene-objects/maps/UsdPrimvarReader_float2
https://docs.openmoonray.org/user-reference/scene-objects/maps/ToonMap
https://docs.openmoonray.org/user-reference/scene-objects/maps/UsdPrimvarReader_float
https://docs.openmoonray.org/user-reference/scene-objects/maps/SwitchFloatMap
https://docs.openmoonray.org/user-reference/scene-objects/maps/ProjectTriplanarMap_v2
https://docs.openmoonray.org/user-reference/scene-objects/maps/RgbToHsvMap
https://docs.openmoonray.org/user-reference/scene-objects/maps/RampMap
https://docs.openmoonray.org/user-reference/scene-objects/maps/ProjectTriplanarMap
https://docs.openmoonray.org/user-reference/scene-objects/maps/RandomMap
https://docs.openmoonray.org/user-reference/scene-objects/maps/RgbToFloatMap
https://docs.openmoonray.org/user-reference/scene-objects/maps/ProjectTriplanarUdimMap
https://docs.openmoonray.org/user-reference/scene-objects/maps/RemapMap
https://docs.openmoonray.org/user-reference/scene-objects/maps/ProjectCameraMap_v2
https://docs.openmoonray.org/user-reference/scene-objects/maps/OpenVdbMap
https://docs.openmoonray.org/user-reference/scene-objects/maps/ProjectPlanarMap
https://docs.openmoonray.org/user-reference/scene-objects/maps/NormalToRgbMap
https://docs.openmoonray.org/user-reference/scene-objects/maps/ProjectSphericalMap
https://docs.openmoonray.org/user-reference/scene-objects/maps/ProjectCameraMap
https://docs.openmoonray.org/user-reference/scene-objects/maps/OpenVdbMap_v2
https://docs.openmoonray.org/user-reference/scene-objects/maps/ProjectCylindricalMap
https://docs.openmoonray.org/user-reference/scene-objects/maps/LODMap
https://docs.openmoonray.org/user-reference/scene-objects/maps/NoiseMap_v2
https://docs.openmoonray.org/user-reference/scene-objects/maps/NoiseWorleyMap_v2
https://docs.openmoonray.org/user-reference/scene-objects/maps/LayerMap
https://docs.openmoonray.org/user-reference/scene-objects/maps/ListMap
https://docs.openmoonray.org/user-reference/scene-objects/maps/HsvToRgbMap
https://docs.openmoonray.org/user-reference/scene-objects/display-filters/ToonDisplayFilter
https://docs.openmoonray.org/user-reference/scene-objects/display-filters/TangentSpaceDisplayFilter
https://docs.openmoonray.org/user-reference/scene-objects/display-filters/RemapDisplayFilter
https://docs.openmoonray.org/user-reference/scene-objects/display-filters/OverDisplayFilter
https://docs.openmoonray.org/user-reference/scene-objects/display-filters/RampDisplayFilter
https://docs.openmoonray.org/user-reference/scene-objects/display-filters/RgbToHsvDisplayFilter
https://docs.openmoonray.org/user-reference/scene-objects/display-filters/RgbToFloatDisplayFilter
https://docs.openmoonray.org/user-reference/scene-objects/display-filters/ShadowDisplayFilter
https://docs.openmoonray.org/user-reference/scene-objects/display-filters/DofDisplayFilter
https://docs.openmoonray.org/user-reference/scene-objects/display-filters/DiscretizeDisplayFilter
https://docs.openmoonray.org/user-reference/scene-objects/display-filters/ConstantDisplayFilter
https://docs.openmoonray.org/user-reference/scene-objects/display-filters/OpDisplayFilter
https://docs.openmoonray.org/user-reference/scene-objects/display-filters/ColorCorrectDisplayFilter
https://docs.openmoonray.org/user-reference/scene-objects/display-filters/HalftoneDisplayFilter
https://docs.openmoonray.org/user-reference/scene-objects/display-filters/ImageDisplayFilter
https://docs.openmoonray.org/user-reference/scene-objects/display-filters/ConvolutionDisplayFilter
https://docs.openmoonray.org/user-reference/scene-objects/maps/HairColorPresetsMap
https://docs.openmoonray.org/user-reference/scene-objects/display-filters/BlendDisplayFilter
https://docs.openmoonray.org/user-reference/scene-objects/maps/GradientMap
https://docs.openmoonray.org/user-reference/scene-objects/display-filters/ClampDisplayFilter
https://docs.openmoonray.org/user-reference/scene-objects/maps/HairColumnMap
https://docs.openmoonray.org/user-reference/scene-objects/maps/ExtraAovMap
https://docs.openmoonray.org/user-reference/scene-objects/maps/HairMap
https://docs.openmoonray.org/user-reference/scene-objects/maps/FloatToRgbMap
https://docs.openmoonray.org/user-reference/scene-objects/maps/ConstantScalarMap
https://docs.openmoonray.org/user-reference/scene-objects/normal-maps/TransformNormalMap
https://docs.openmoonray.org/user-reference/scene-objects/maps/ConstantColorMap
https://docs.openmoonray.org/user-reference/scene-objects/maps/CurvatureMap
https://docs.openmoonray.org/user-reference/scene-objects/maps/DirectionalMap
https://docs.openmoonray.org/user-reference/scene-objects/maps/DeformationMap
https://docs.openmoonray.org/user-reference/scene-objects/maps/ColorCorrectTMIMap
https://docs.openmoonray.org/user-reference/scene-objects/maps/DebugMap
https://docs.openmoonray.org/user-reference/how-to-guides/checkpoint-resume/resume/on-resume-LUA-script
https://docs.openmoonray.org/user-reference/how-to-guides/checkpoint-resume/kj-sequence
https://docs.openmoonray.org/user-reference/scene-objects/maps
https://docs.openmoonray.org/user-reference/how-to-guides/checkpoint-resume/sample-rdla
https://docs.openmoonray.org/user-reference/how-to-guides/checkpoint-resume/file-output-logic
https://docs.openmoonray.org/user-reference/how-to-guides/checkpoint-resume/exr-metadata
https://docs.openmoonray.org/user-reference/how-to-guides/checkpoint-resume/resume
https://docs.openmoonray.org/user-reference/how-to-guides/checkpoint-resume/checkpoint
https://docs.openmoonray.org/user-reference/how-to-guides/checkpoint-resume/checkpoint/optional-checkpoint-sceneVariables
https://docs.openmoonray.org/user-reference/how-to-guides/checkpoint-resume/checkpoint/sigint-interruption
https://docs.openmoonray.org/user-reference/how-to-guides/checkpoint-resume/checkpoint/how-to-use-checkpoint
https://docs.openmoonray.org/user-reference/how-to-guides/checkpoint-resume/checkpoint/post-checkpoint-LUA-script
https://docs.openmoonray.org/user-reference/tools/hydra
https://docs.openmoonray.org/getting-started/about
https://docs.openmoonray.org/getting-started/test-scenes
https://docs.openmoonray.org/getting-started/about/arras
https://docs.openmoonray.org/getting-started
https://docs.openmoonray.org/user-reference/scene-objects
https://docs.openmoonray.org/developer-reference/shaders/volume-shaders
https://docs.openmoonray.org/developer-reference/shaders/normal-maps
https://docs.openmoonray.org/developer-reference/shaders/materials
https://docs.openmoonray.org/developer-reference/shaders/lights
https://docs.openmoonray.org/developer-reference/shaders/light-filters
https://docs.openmoonray.org/developer-reference/source-structure
https://docs.openmoonray.org/user-reference/scene-objects/normal-maps/RgbToNormalMap
https://docs.openmoonray.org/getting-started/about/rdl-scene-format
https://docs.openmoonray.org/developer-reference/shaders/displacement
https://docs.openmoonray.org/developer-reference/shaders/display-filters
https://docs.openmoonray.org/developer-reference/shaders/cameras
https://docs.openmoonray.org/developer-reference/arras/distributed-arras
https://docs.openmoonray.org/developer-reference/arras/arras-client-api
https://docs.openmoonray.org/developer-reference/arras/arras-session-definitions
https://docs.openmoonray.org/developer-reference/scene_rdl2-library
https://docs.openmoonray.org/user-reference/scene-objects/materials/hair/HairColorCorrectMaterial
https://docs.openmoonray.org/user-reference/scene-objects/materials/hair/HairDiffuseMaterial
https://docs.openmoonray.org/user-reference/scene-objects/materials/hair/HairMaterial_v3
https://docs.openmoonray.org/user-reference/scene-objects/materials/hair/HairLayerMaterial
https://docs.openmoonray.org/user-reference/scene-objects/materials/hair/HairToonMaterial
https://docs.openmoonray.org/user-reference/scene-objects/materials/dwa/DwaRefractiveMaterial
https://docs.openmoonray.org/user-reference/scene-objects/materials/dwa/DwaTwoSidedMaterial
https://docs.openmoonray.org/user-reference/scene-objects/materials/dwa/DwaSolidDielectricMaterial
https://docs.openmoonray.org/user-reference/scene-objects/materials/dwa/DwaVelvetMaterial_v2
https://docs.openmoonray.org/user-reference/scene-objects/materials/dwa/DwaToonMaterial
https://docs.openmoonray.org/user-reference/scene-objects/materials/dwa/DwaSkinMaterial
https://docs.openmoonray.org/user-reference/scene-objects/materials/dwa/DwaSwitchMaterial
https://docs.openmoonray.org/user-reference/scene-objects/materials/dwa/DwaBaseMaterial
https://docs.openmoonray.org/user-reference/scene-objects/materials/dwa/DwaEmissiveMaterial
https://docs.openmoonray.org/user-reference/scene-objects/materials/dwa/DwaFabricMaterial
https://docs.openmoonray.org/user-reference/scene-objects/materials/dwa/DwaAdjustMaterial
https://docs.openmoonray.org/user-reference/scene-objects/materials/dwa/DwaLayerMaterial
https://docs.openmoonray.org/user-reference/scene-objects/materials/dwa/DwaColorCorrectMaterial
https://docs.openmoonray.org/user-reference/scene-objects/materials/dwa/DwaMetalMaterial
https://docs.openmoonray.org/user-reference/scene-objects/materials/dwa/DwaMixMaterial
https://docs.openmoonray.org/user-reference/scene-objects/materials/hair
https://docs.openmoonray.org/user-reference/scene-objects/materials/dwa
https://docs.openmoonray.org/user-reference/scene-objects/materials/RaySwitchMaterial
https://docs.openmoonray.org/user-reference/scene-objects/materials/SwitchMaterial
https://docs.openmoonray.org/user-reference/scene-objects/materials/UsdPreviewSurface
https://docs.openmoonray.org/user-reference/how-to-guides/instance-level-transforms
https://docs.openmoonray.org/user-reference/scene-objects/geometry/VdbGeometry
https://docs.openmoonray.org/user-reference/scene-objects/materials
https://docs.openmoonray.org/user-reference/performance
https://docs.openmoonray.org/user-reference/how-to-guides/render-outputs