dragndrop_hld/FAILED_LAYERS_SUMMARY.md

Failed Layers Summary - All Errors

Overview

Total Layers Tested: 10 Failed Layers: 7 Success Rate: 30%

---

1. Access Points (access_points.shp)

Status: ❌ FAILED (0/10 records)

Error Type: API 500 Error - Field Name Mismatch

Error Message:

PHP Warning: Undefined array key "isLocked"

Problem:

• Sending field: isLocked
• API expects: locked

Current Code (Line 407):

ap_data = {
    "mapProjectId": int(map_id),
    "name": f"AP-{idx}",
    "latitude": str(lat),
    "longitude": str(lon),
    "typeId": type_id,
    "isLocked": 0  # ❌ WRONG FIELD NAME
}

Required Fix:

ap_data = {
    "mapProjectId": int(map_id),
    "name": f"AP-{idx}",
    "latitude": str(lat),
    "longitude": str(lon),
    "typeId": type_id,
    "locked": 0  # ✅ CORRECT FIELD NAME
}

File Location: /home/ahall/Sandbox/dragnddrop/backend/verofy_uploader.py:407

---

2. Network Elements (network_elements.shp)

Status: ❌ FAILED (0/10 records)

Error Type: API 500 Error - Silent Failure (no debug output)

Error Message:

(No error message displayed - silent failure)

Problem:

• Code was recently updated with typeId mapping
• No debug output to see what data is being sent
• Likely missing a required field or incorrect field format

Current Code (Lines 800-813):

def _create_network_element(self, ne_data: Dict) -> bool:
    """Create a network element via Verofy API"""
    headers = {
        "Authorization": f"Bearer {self.access_token}",
        "Content-Type": "application/json"
    }

    response = requests.post(
        f"{API_URL}/map-network-element/create",
        headers=headers,
        json=ne_data
    )

    return response.status_code == 201

Required Fix:

• Add debug output (like sites/access_points have)
• Add error logging to see API response

def _create_network_element(self, ne_data: Dict) -> bool:
    """Create a network element via Verofy API"""
    headers = {
        "Authorization": f"Bearer {self.access_token}",
        "Content-Type": "application/json"
    }

    print(f"DEBUG: Sending network element data: {json.dumps(ne_data, indent=2)}")

    response = requests.post(
        f"{API_URL}/map-network-element/create",
        headers=headers,
        json=ne_data
    )

    if response.status_code != 201:
        print(f"❌ Network Element API Error {response.status_code}: {response.text[:200]}")
        return False

    return True

File Location: /home/ahall/Sandbox/dragnddrop/backend/verofy_uploader.py:800-813

API Endpoint: POST /v1/map-network-element/create

---

3. Splicing (splicing.shp)

Status: ❌ FAILED (0/10 records)

Error Type: API 500 Error - Silent Failure (no debug output)

Error Message:

(No error message displayed - silent failure)

Problem:

• Code was recently updated with typeId mapping
• No debug output to see what data is being sent
• Likely missing a required field or incorrect field format

Current Code (Lines 850-862):

def _create_splicing(self, splicing_data: Dict) -> bool:
    """Create a splicing point via Verofy API"""
    headers = {
        "Authorization": f"Bearer {self.access_token}",
        "Content-Type": "application/json"
    }

    # Assuming splicing uses similar endpoint to network elements or sites
    response = requests.post(
        f"{API_URL}/map-splicing/create",
        headers=headers,
        json=splicing_data
    )

    return response.status_code == 201

Required Fix:

• Add debug output
• Add error logging

def _create_splicing(self, splicing_data: Dict) -> bool:
    """Create a splicing point via Verofy API"""
    headers = {
        "Authorization": f"Bearer {self.access_token}",
        "Content-Type": "application/json"
    }

    print(f"DEBUG: Sending splicing data: {json.dumps(splicing_data, indent=2)}")

    response = requests.post(
        f"{API_URL}/map-splice/create",  # Note: endpoint is map-splice, not map-splicing
        headers=headers,
        json=splicing_data
    )

    if response.status_code != 201:
        print(f"❌ Splicing API Error {response.status_code}: {response.text[:200]}")
        return False

    return True

File Location: /home/ahall/Sandbox/dragnddrop/backend/verofy_uploader.py:850-862

API Endpoint: POST /v1/map-splice/create (not map-splicing!)

Note: The endpoint might be incorrect - it should be map-splice, not map-splicing

---

4. Cabinet Boundaries (cabinet_boundaries.shp)

Status: ❌ FAILED (0/3 records)

Error Type: API 500 Error - Missing Required Field

Error Message:

Database Exception: SQLSTATE[HY000]: General error: 1364 Field 'metric' doesn't have a default value

Problem:

• Missing required field: metric
• The mapobject table requires this field

Current Code (Lines 549-563):

info_data = {
    "mapProjectId": int(map_id),
    "name": str(row.get('Name', f'Cabinet-Boundary-{idx}')),
    "mapinfoobjecttypeId": 3,  # 3 = Polygon
    "data": data,
    "color": "#ffffff",
    "alpha": "0.40"
    # ❌ MISSING: "metric" field
}

Required Fix:

info_data = {
    "mapProjectId": int(map_id),
    "name": str(row.get('Name', f'Cabinet-Boundary-{idx}')),
    "mapinfoobjecttypeId": 3,  # 3 = Polygon
    "data": data,
    "color": "#ffffff",
    "alpha": "0.40",
    "metric": 0  # ✅ ADD THIS REQUIRED FIELD
}

File Location: /home/ahall/Sandbox/dragnddrop/backend/verofy_uploader.py:549-563

---

5. Cables (cables.shp)

Status: ❌ FAILED (0/3 records)

Error Type: API 500 Error - Missing Required Field

Error Message:

Database Exception: SQLSTATE[HY000]: General error: 1364 Field 'metric' doesn't have a default value

Problem:

• Missing required field: metric
• Same issue as cabinet_boundaries

Current Code (Lines 591-598):

info_data = {
    "mapProjectId": int(map_id),
    "name": str(row.get('Name', f'Cable-{idx}')),
    "mapinfoobjecttypeId": 2,  # 2 = Line/Polyline
    "data": data,
    "color": "#ffffff",
    "alpha": "1.00"
    # ❌ MISSING: "metric" field
}

Required Fix:

info_data = {
    "mapProjectId": int(map_id),
    "name": str(row.get('Name', f'Cable-{idx}')),
    "mapinfoobjecttypeId": 2,  # 2 = Line/Polyline
    "data": data,
    "color": "#ffffff",
    "alpha": "1.00",
    "metric": 0  # ✅ ADD THIS REQUIRED FIELD
}

File Location: /home/ahall/Sandbox/dragnddrop/backend/verofy_uploader.py:591-598

---

6. Parcels (parcels.shp)

Status: ❌ FAILED (0/3 records)

Error Type: API 500 Error - Missing Required Field

Error Message:

Database Exception: SQLSTATE[HY000]: General error: 1364 Field 'metric' doesn't have a default value

Problem:

• Missing required field: metric
• Same issue as cabinet_boundaries and cables

Current Code (Lines 634-641):

info_data = {
    "mapProjectId": int(map_id),
    "name": str(row.get('Name', f'Parcel-{idx}')),
    "mapinfoobjecttypeId": 3,  # 3 = Polygon
    "data": data,
    "color": "#ffffff",
    "alpha": "0.40"
    # ❌ MISSING: "metric" field
}

# Add optional fields (Group 1/2 map to objectgroup/objectgroup2)
if 'Group 1' in row and row['Group 1']:
    info_data['objectgroup'] = str(row['Group 1'])

if 'Group 2' in row and row['Group 2']:
    info_data['objectgroup2'] = str(row['Group 2'])

Required Fix:

info_data = {
    "mapProjectId": int(map_id),
    "name": str(row.get('Name', f'Parcel-{idx}')),
    "mapinfoobjecttypeId": 3,  # 3 = Polygon
    "data": data,
    "color": "#ffffff",
    "alpha": "0.40",
    "metric": 0  # ✅ ADD THIS REQUIRED FIELD
}

# Add optional fields (Group 1/2 map to objectgroup/objectgroup2)
if 'Group 1' in row and row['Group 1']:
    info_data['objectgroup'] = str(row['Group 1'])

if 'Group 2' in row and row['Group 2']:
    info_data['objectgroup2'] = str(row['Group 2'])

File Location: /home/ahall/Sandbox/dragnddrop/backend/verofy_uploader.py:634-641

---

7. Permits (permits.shp)

Status: ❌ FAILED (0/10 records)

Error Type: API 422 Validation Error - Missing Required Fields

Error Message:

[
  {"field":"mappermitstatusId","message":"Permit Status cannot be blank."},
  {"field":"mappermitentitytypeId","message":"Permit Entity Type cannot be blank."},
  {"field":"mappermitulrtypeId","message":"Permit ULR Type cannot be blank."}
]

Problem:

• Missing 3 required fields:
  1. mappermitstatusId - Status of the permit
  2. mappermitentitytypeId - Entity type (e.g., company, individual)
  3. mappermitulrtypeId - ULR (Utility Location Request?) type

Current Code (Lines 699-703):

permit_data = {
    "mapProjectId": int(map_id),
    "name": str(name),
    "poly": poly,
    # ❌ MISSING: mappermitstatusId
    # ❌ MISSING: mappermitentitytypeId
    # ❌ MISSING: mappermitulrtypeId
}

Required Fix:

permit_data = {
    "mapProjectId": int(map_id),
    "name": str(name),
    "poly": poly,
    "mappermitstatusId": 1,        # ✅ ADD: Default status
    "mappermitentitytypeId": 1,    # ✅ ADD: Default entity type
    "mappermitulrtypeId": 1        # ✅ ADD: Default ULR type
}

File Location: /home/ahall/Sandbox/dragnddrop/backend/verofy_uploader.py:699-703

Note: Need to fetch the reference data to determine correct default values:

• MapPermitStatus references
• MapPermitEntityType references
• MapPermitULRType references

---

Summary Table

#	Layer	Records Failed	Error Type	Primary Issue	Fix Complexity
1	access_points	10	Field Name	Wrong field name: isLocked → locked	⭐ Easy
2	network_elements	10	Unknown	Silent 500 error - needs debugging	⭐⭐ Medium
3	splicing	10	Unknown	Silent 500 error - needs debugging	⭐⭐ Medium
4	cabinet_boundaries	3	Missing Field	Add metric: 0	⭐ Easy
5	cables	3	Missing Field	Add metric: 0	⭐ Easy
6	parcels	3	Missing Field	Add metric: 0	⭐ Easy
7	permits	10	Missing Fields	Add 3 required fields with defaults	⭐⭐ Medium

Total Failed Records: 49 out of 59 records (83% failure rate for failed layers)

---

Priority Order for Fixes

Priority 1 - Quick Wins (Should fix immediately)

1. Access Points - One-line fix (change field name)
2. Cabinet Boundaries - One-line fix (add metric field)
3. Cables - One-line fix (add metric field)
4. Parcels - One-line fix (add metric field)

Priority 2 - Requires Research

5. Permits - Need to research correct reference IDs
6. Network Elements - Add debug output, test, fix based on error
7. Splicing - Add debug output, test, fix based on error (also check endpoint name)

---

Action Plan

1. Fix Priority 1 items (4 layers) - should take 5 minutes
2. Re-run test to verify Priority 1 fixes work
3. Research permit references and add defaults
4. Add debug output to network_elements and splicing
5. Re-run test with debug to see exact errors
6. Fix remaining issues based on error output