Human Generated Data

Title

Untitled (Yogyakarta, Java)

Date

January 26, 1960-February 2, 1960

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5049

Human Generated Data

Title

Untitled (Yogyakarta, Java)

People

Artist: Ben Shahn, American 1898 - 1969

Date

January 26, 1960-February 2, 1960

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5049

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Boy 99.1
Child 99.1
Male 99.1
Person 99.1
Male 99
Person 99
Adult 99
Man 99
Machine 98.7
Wheel 98.7
Male 98.5
Person 98.5
Adult 98.5
Man 98.5
Person 98.3
Male 98.3
Person 98.3
Adult 98.3
Man 98.3
Cycling 98.2
Sport 98.2
Transportation 98.2
Vehicle 98.2
Wheel 98
Wheel 97.5
Wheel 97.4
Bicycle 97.3
Bicycle 97.3
Wheel 97.2
Bicycle 97.1
Wheel 97.1
Person 96.8
Wheel 96.4
Person 95.7
Wheel 95.4
Wheel 95.3
Person 94.7
Wheel 94.7
Person 93.6
Bicycle 92.9
Person 91.8
Person 91.7
Face 88.1
Head 88.1
Person 87.9
Wheel 86.8
Person 86.7
Wheel 81.4
Person 80.2
Bicycle 75.9
Car 71.1
Person 71.1
Helmet 70.7
Wheel 67.4
Person 62.6
Person 62.3
Wheel 61.3
Accessories 60.2
Glasses 60.2
Spoke 55.5
People 55.2

Clarifai
created on 2018-05-10

people 99.9
group together 99.4
many 99
vehicle 98.9
street 98.7
group 98.5
transportation system 98.2
man 96.5
woman 95.8
adult 95.7
road 92.6
biker 91.7
seated 90.9
several 90.4
crowd 89.8
wheel 86.9
child 85.8
recreation 85.3
bike 85
cyclist 81.2

Imagga
created on 2023-10-06

jinrikisha 100
cart 100
wagon 88
wheeled vehicle 74
bicycle 66.9
bike 55.7
vehicle 44.9
wheelchair 32.8
cycle 32.3
ride 30.1
riding 29.3
outdoors 28.6
cycling 28.6
sport 28.2
transportation 27.8
man 26.9
wheel 26.4
people 24
street 24
transport 22.9
active 22.5
recreation 22.4
lifestyle 21
road 19.9
tricycle 19.3
chair 18.7
health 18.1
summer 18
outside 18
seat 17.8
park 17.3
activity 17
biking 16.8
old 16
city 15.8
travel 15.5
exercise 15.4
helmet 15.4
outdoor 14.5
fun 14.2
cyclist 14.1
happy 13.8
adult 13.6
male 13.5
leisure 13.3
healthy 13.2
senior 13.1
urban 13.1
person 13.1
disabled 12.8
vacation 12.3
motion 12
speed 11.9
bicyclist 11.9
mountain 11.6
care 11.5
traffic 11.4
pedal 10.9
aged 10.9
biker 10.9
fitness 10.9
smiling 10.1
disability 9.9
rider 9.8
couple 9.6
sky 9.6
help 9.3
sports 9.3
countryside 9.1
bikes 8.9
family 8.9
retired 8.7
elderly 8.6
happiness 8.6
men 8.6
husband 8.6
enjoying 8.5
tourism 8.3
invalid 7.9
handicapped 7.9
together 7.9
smile 7.8
wheels 7.8
sick 7.7
tour 7.7
driving 7.7
support 7.7
illness 7.6
adventure 7.6
blur 7.4
fit 7.4
teenager 7.3
new 7.3
tourist 7.3
color 7.2
body 7.2
conveyance 7.1
love 7.1

Microsoft
created on 2018-05-10

outdoor 99.7
sky 99.5
person 94.2
people 79.6
group 61.2
bicycle 21.1

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 16-24
Gender Male, 100%
Confused 39.7%
Calm 32.8%
Sad 9.3%
Disgusted 8.3%
Surprised 6.8%
Fear 6.4%
Angry 5.4%
Happy 0.6%

AWS Rekognition

Age 4-12
Gender Female, 99.7%
Calm 81.6%
Confused 7.6%
Surprised 7.3%
Fear 6.2%
Angry 2.8%
Sad 2.7%
Disgusted 2.1%
Happy 1.3%

AWS Rekognition

Age 25-35
Gender Male, 88.6%
Calm 98.3%
Surprised 6.4%
Fear 5.9%
Sad 2.2%
Angry 0.5%
Disgusted 0.2%
Happy 0.2%
Confused 0.1%

AWS Rekognition

Age 31-41
Gender Male, 95%
Happy 70.7%
Fear 10.4%
Surprised 7.7%
Angry 6.1%
Sad 3.8%
Calm 3.3%
Disgusted 2.4%
Confused 1.6%

AWS Rekognition

Age 30-40
Gender Male, 80.5%
Calm 50%
Surprised 24.7%
Happy 10%
Angry 7.9%
Sad 6.5%
Fear 6.1%
Confused 3.4%
Disgusted 1.5%

AWS Rekognition

Age 37-45
Gender Male, 99.9%
Sad 60.5%
Confused 44.7%
Calm 11%
Surprised 8%
Fear 6.3%
Happy 3.7%
Angry 3.5%
Disgusted 3.2%

AWS Rekognition

Age 22-30
Gender Male, 100%
Sad 84.9%
Confused 26.1%
Calm 22.9%
Surprised 7.5%
Fear 6.1%
Angry 5.8%
Happy 2.4%
Disgusted 1.1%

AWS Rekognition

Age 28-38
Gender Male, 99.9%
Sad 99.7%
Calm 20.7%
Surprised 8.8%
Fear 6.1%
Angry 3%
Confused 2%
Disgusted 1.5%
Happy 1.4%

AWS Rekognition

Age 16-24
Gender Male, 95.2%
Calm 76.8%
Sad 23.2%
Surprised 6.4%
Fear 6%
Confused 3.7%
Disgusted 0.3%
Angry 0.2%
Happy 0.1%

AWS Rekognition

Age 20-28
Gender Male, 78.1%
Calm 68.8%
Happy 16.2%
Sad 11.7%
Surprised 6.4%
Fear 6%
Angry 1.1%
Confused 0.5%
Disgusted 0.3%

AWS Rekognition

Age 24-34
Gender Male, 99.7%
Happy 81.3%
Calm 13.7%
Surprised 6.7%
Fear 5.9%
Sad 2.6%
Angry 1.2%
Disgusted 0.8%
Confused 0.4%

AWS Rekognition

Age 6-14
Gender Female, 54.1%
Calm 90.6%
Surprised 9.2%
Fear 5.9%
Happy 2.5%
Sad 2.3%
Confused 0.6%
Disgusted 0.5%
Angry 0.3%

AWS Rekognition

Age 20-28
Gender Female, 69.1%
Calm 85%
Fear 7.5%
Surprised 6.7%
Sad 5.2%
Happy 1.7%
Disgusted 1.1%
Confused 0.6%
Angry 0.5%

Microsoft Cognitive Services

Age 23
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Boy 99.1%
Child 99.1%
Male 99.1%
Person 99.1%
Adult 99%
Man 99%
Wheel 98.7%
Bicycle 97.3%
Car 71.1%
Helmet 70.7%
Glasses 60.2%

Categories