Human Generated Data

Title

Untitled (Java)

Date

January 26, 1960-February 2, 1960

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5074

Human Generated Data

Title

Untitled (Java)

People

Artist: Ben Shahn, American 1898 - 1969

Date

January 26, 1960-February 2, 1960

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5074

Machine Generated Data

Tags

Amazon
created on 2023-10-07

Flower 100
Flower Arrangement 100
Plant 100
Flower Bouquet 100
Child 98.8
Female 98.8
Girl 98.8
Person 98.8
Person 98.7
Formal Wear 98
Clothing 97.9
Suit 97.9
Person 97.1
Dress 95.7
Person 94.8
Adult 94.8
Male 94.8
Man 94.8
Person 93.6
Female 93.2
Person 93.2
Adult 93.2
Woman 93.2
Person 93
Adult 93
Male 93
Man 93
Fashion 92.9
Gown 92.9
Wedding 92.9
Wedding Gown 92.9
Face 92
Head 92
Furniture 90
Table 90
Person 88.6
Coat 79.4
Person 73.9
Food 69.1
Fruit 69.1
Produce 69.1
Architecture 65.3
Building 65.3
Hospital 65.3
Bridegroom 64.4
Photography 63.5
Portrait 63.5
Indoors 61.8
Dining Table 57.8
Potted Plant 57.8
Cup 57.2
Pineapple 56.7
People 56.2
Dining Room 56.2
Room 56.2
Altar 56.2
Church 56.2
Prayer 56.2
Restaurant 55.2

Clarifai
created on 2018-05-10

people 99.9
group 98.6
adult 98.3
man 94.8
group together 92.9
woman 90.5
many 90.4
several 88.1
two 87.7
vehicle 84.6
wear 84.3
administration 82.1
one 82
three 81.7
outfit 80.8
furniture 80.2
child 80.1
war 80
military 79.3
veil 74.6

Imagga
created on 2023-10-07

male 29.8
people 28.4
man 26.9
person 24.2
couple 20.9
adult 20.7
men 20.6
groom 19.2
happiness 18.8
happy 18.2
photographer 16
bride 14.4
spectator 14.3
two 13.5
married 13.4
love 13.4
business 13.4
senior 13.1
room 13
smiling 13
engineer 12.9
office 12.3
sitting 12
wedding 11.9
old 11.8
work 11.8
dress 11.7
businessman 11.5
park 10.7
smile 10.7
husband 10.5
marriage 10.4
bouquet 10.4
portrait 10.3
women 10.3
world 10
suit 10
group 9.7
television camera 9.6
laptop 9.6
wife 9.5
lifestyle 9.4
outdoor 9.2
hand 9.1
outdoors 8.9
lady 8.9
together 8.8
day 8.6
architecture 8.6
vehicle 8.4
mature 8.4
summer 8.4
holding 8.2
human 8.2
cheerful 8.1
computer 8.1
new 8.1
home 8
celebration 8
working 7.9
education 7.8
corporate 7.7
modern 7.7
television equipment 7.7
sky 7.6
building 7.6
technology 7.4
indoor 7.3
black 7.2
looking 7.2
family 7.1
teacher 7.1
travel 7

Google
created on 2018-05-10

Microsoft
created on 2018-05-10

person 89
old 70.8
posing 45.5
vintage 25.9

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 2-8
Gender Male, 98.7%
Sad 99.9%
Calm 18%
Surprised 6.4%
Fear 6%
Confused 2.4%
Angry 0.3%
Disgusted 0.2%
Happy 0.1%

AWS Rekognition

Age 19-27
Gender Male, 85.1%
Calm 99.9%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Confused 0%
Disgusted 0%
Angry 0%
Happy 0%

AWS Rekognition

Age 14-22
Gender Female, 99.7%
Calm 78.2%
Sad 24.1%
Surprised 6.4%
Fear 6%
Angry 0.9%
Happy 0.8%
Disgusted 0.6%
Confused 0.3%

AWS Rekognition

Age 6-16
Gender Male, 99.5%
Sad 100%
Surprised 6.3%
Fear 5.9%
Confused 1.9%
Calm 0.3%
Disgusted 0.2%
Angry 0.1%
Happy 0.1%

AWS Rekognition

Age 10-18
Gender Female, 100%
Sad 97.6%
Calm 43.6%
Surprised 7.1%
Fear 6.2%
Confused 0.5%
Disgusted 0.3%
Angry 0.2%
Happy 0.1%

AWS Rekognition

Age 12-20
Gender Male, 99.7%
Sad 99.6%
Calm 32.5%
Surprised 6.4%
Fear 6%
Angry 0.4%
Confused 0.2%
Disgusted 0.2%
Happy 0.1%

Microsoft Cognitive Services

Age 12
Gender Female

Microsoft Cognitive Services

Age 48
Gender Female

Microsoft Cognitive Services

Age 8
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Child 98.8%
Female 98.8%
Girl 98.8%
Person 98.8%
Adult 94.8%
Male 94.8%
Man 94.8%
Woman 93.2%
Cup 57.2%

Categories