Human Generated Data

Title

Untitled (Yogyakarta, Java)

Date

January 26, 1960-February 2, 1960

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2378

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Yogyakarta, Java)

People

Artist: Ben Shahn, American 1898 - 1969

Date

January 26, 1960-February 2, 1960

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2378

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Person 99.1
Person 97.9
Bicycle 97.9
Transportation 97.9
Vehicle 97.9
City 97.3
Person 97.2
Person 97.2
Person 96.1
Person 95.4
Person 95.3
Person 94.1
Person 94
Bicycle 93.7
Bicycle 93.5
Urban 93.4
Person 93
Machine 92.4
Wheel 92.4
Person 91.2
Wheel 90.6
Person 90.1
Bicycle 89.8
Road 89.3
Animal 88.9
Horse 88.9
Mammal 88.9
Street 88.8
Person 88.7
Wheel 88.5
Bicycle 88.5
Wheel 86.5
Wheel 84.9
Wheel 84.6
Person 84.1
Wheel 83.7
Person 83.4
Person 82.6
Person 82.4
Wheel 82.2
Person 82
Bicycle 81.7
Person 80.7
Bicycle 78.5
Carriage 78.1
Person 77.8
Bicycle 77.3
Wagon 75.4
Clothing 75.1
Footwear 75.1
Shoe 75.1
Accessories 73.1
Bag 73.1
Handbag 73.1
Motorcycle 73
Person 72.9
Person 71.3
Tricycle 69.8
Person 69.5
Bicycle 69.4
Wheel 68.8
Person 68
Wheel 67.5
Person 67.3
Person 67.1
Light 66.9
Traffic Light 66.9
Wheel 66.6
Shoe 65.1
Face 63
Head 63
Person 62.9
Bicycle 62
Person 61
Motorcycle 58.5
Horse Cart 56.8
Spoke 56.3
Antique Car 55.4
Car 55.4
Model T 55.4

Clarifai
created on 2018-05-10

people 99.9
group together 99.7
street 99.5
vehicle 99
group 99
transportation system 98.7
many 98.2
man 96.6
adult 96.1
road 96.1
woman 93.9
driver 89.5
monochrome 88.7
several 88.5
carriage 87.6
crowd 84.8
child 84.4
cavalry 83
administration 81.9
two 79.8

Imagga
created on 2023-10-06

jinrikisha 100
cart 100
wagon 100
wheeled vehicle 75.7
vehicle 45.2
transportation 35
carriage 30
street 26.7
wheelchair 23.9
bicycle 23.5
wheel 22.7
old 22.3
city 21.6
bike 20.5
man 18.8
transport 18.3
outdoors 17.9
road 17.2
horse 17.1
disabled 16.8
ride 16.5
travel 16.2
urban 14.9
chair 14.4
care 14
people 13.4
disability 12.8
active 12.6
health 12.5
park 12.4
outside 12
help 11.2
historic 11
handicapped 10.9
cycle 10.7
riding 10.7
illness 10.5
support 10.3
senior 10.3
summer 10.3
architecture 10.2
outdoor 9.9
male 9.9
activity 9.9
mobility 9.8
sick 9.7
historical 9.4
lifestyle 9.4
tourist 9.1
sport 9.1
aged 9.1
vacation 9
history 8.9
invalid 8.9
impairment 8.9
seat 8.9
wheels 8.8
retired 8.7
building 8.7
adult 8.4
person 8.3
tourism 8.3
handicap 7.9
facility 7.9
cycling 7.9
physical 7.8
retirement 7.7
elderly 7.7
husband 7.6
traffic 7.6
hospital 7.5
exterior 7.4
equipment 7.3
recreation 7.2
trees 7.1
family 7.1
medical 7.1

Google
created on 2018-05-10

Microsoft
created on 2018-05-10

outdoor 99.8
sky 99.4
road 99.4
tree 98
street 81.7
people 76.9
drawn 54.9
horse-drawn vehicle 54.6
carriage 45.9
pulling 33.5
several 14.9

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 9-17
Gender Female, 98.1%
Calm 34.5%
Happy 21%
Angry 12.3%
Surprised 11.3%
Fear 10.9%
Sad 5.1%
Confused 4.9%
Disgusted 3.7%

AWS Rekognition

Age 20-28
Gender Male, 95.3%
Calm 44.5%
Confused 37.8%
Surprised 7.3%
Fear 6.8%
Sad 4.8%
Angry 4.4%
Disgusted 2.1%
Happy 1.2%

AWS Rekognition

Age 6-16
Gender Male, 97.2%
Surprised 99.6%
Fear 6.2%
Sad 2.4%
Happy 1%
Confused 1%
Angry 0.7%
Calm 0.7%
Disgusted 0.4%

AWS Rekognition

Age 28-38
Gender Male, 98.9%
Sad 99.7%
Calm 24.9%
Surprised 6.5%
Fear 6.4%
Happy 2%
Confused 1.9%
Angry 1.6%
Disgusted 1.1%

AWS Rekognition

Age 14-22
Gender Female, 96.5%
Calm 62.3%
Fear 28.2%
Surprised 9.3%
Confused 2.5%
Sad 2.4%
Angry 0.8%
Disgusted 0.6%
Happy 0.6%

AWS Rekognition

Age 21-29
Gender Male, 99.1%
Disgusted 39.7%
Calm 24.7%
Angry 9.7%
Happy 9.7%
Sad 7.4%
Fear 7.2%
Surprised 7.2%
Confused 2.2%

AWS Rekognition

Age 16-24
Gender Female, 98.1%
Calm 86.5%
Surprised 6.9%
Fear 6.4%
Confused 3.3%
Sad 3%
Angry 2.5%
Disgusted 1.4%
Happy 1.3%

AWS Rekognition

Age 22-30
Gender Female, 54.5%
Disgusted 65.2%
Fear 8.4%
Surprised 8.1%
Confused 7.4%
Sad 5.5%
Calm 5.2%
Angry 4.8%
Happy 1.5%

AWS Rekognition

Age 18-24
Gender Male, 98%
Calm 99.5%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Happy 0.1%
Disgusted 0%
Angry 0%
Confused 0%

AWS Rekognition

Age 31-41
Gender Female, 95.3%
Sad 94.5%
Calm 25.5%
Happy 12.2%
Surprised 12%
Fear 6.1%
Confused 3.5%
Angry 2.6%
Disgusted 0.7%

AWS Rekognition

Age 16-22
Gender Male, 81.3%
Calm 59.3%
Angry 22.7%
Fear 8.6%
Surprised 6.6%
Sad 4.8%
Disgusted 2.2%
Confused 2%
Happy 1.3%

AWS Rekognition

Age 16-24
Gender Male, 99.1%
Fear 97.4%
Surprised 6.4%
Sad 2.3%
Calm 1.6%
Happy 1.4%
Angry 0.3%
Confused 0.3%
Disgusted 0.2%

AWS Rekognition

Age 19-27
Gender Male, 97.1%
Calm 82.2%
Surprised 7.6%
Fear 6.3%
Sad 5.5%
Angry 3.1%
Happy 2.7%
Confused 1.1%
Disgusted 0.5%

AWS Rekognition

Age 4-10
Gender Male, 96.2%
Fear 60.1%
Calm 35.9%
Surprised 6.8%
Sad 4.5%
Happy 4.1%
Angry 3.6%
Disgusted 1.5%
Confused 1.2%

AWS Rekognition

Age 14-22
Gender Male, 96.2%
Calm 65.7%
Sad 14.5%
Fear 9.5%
Surprised 7.4%
Confused 3.9%
Angry 3%
Happy 1.7%
Disgusted 1.6%

Feature analysis

Amazon

Person 99.1%
Bicycle 97.9%
Wheel 92.4%
Horse 88.9%
Shoe 75.1%
Handbag 73.1%

Categories