Human Generated Data

Title

Untitled (mock wedding party studio portrait)

Date

c. 1933, printed later

People

Artist: Durette Studio, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.5866

Human Generated Data

Title

Untitled (mock wedding party studio portrait)

People

Artist: Durette Studio, American 20th century

Date

c. 1933, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-11-16

Human 99.8
Person 99.8
Person 99.7
Person 99.7
Person 99.3
Apparel 98.6
Clothing 98.6
Person 97.1
Person 95.2
Shoe 90.1
Footwear 90.1
Person 82.5
Shoe 81.7
People 80.9
Crowd 75.5
Fashion 67.7
Robe 67.7
Gown 64.6
Wedding 61.1
Wedding Gown 59
Art 58.5

Clarifai
created on 2019-11-16

people 100
group 99.7
many 99.7
group together 98.5
adult 97.3
woman 96.7
recreation 95.8
wear 95.3
leader 94
actress 93.5
music 93.4
outfit 93.2
administration 93.1
man 92.8
child 92.8
street 88.3
musician 86.3
several 86.2
crowd 84.1
actor 82.5

Imagga
created on 2019-11-16

kin 35.6
people 34.6
brass 28.3
person 25.9
wind instrument 24.9
man 24.2
group 22.6
silhouette 21.5
adult 19.9
singer 19.5
male 19.1
cornet 18.7
musical instrument 18.3
city 17.4
musician 17.4
business 17
women 16.6
men 15.4
performer 15.4
crowd 15.4
world 15.3
businessman 15
black 14.6
team 13.4
dark 13.4
portrait 12.9
human 12.7
dress 12.6
clothing 12.3
urban 12.2
fashion 12.1
old 11.8
walking 11.4
teamwork 11.1
street 11
pose 10.9
entertainer 10
uniform 9.9
travel 9.8
celebration 9.6
work 9.4
happy 9.4
fun 9
building 9
couple 8.7
standing 8.7
dance 8.4
girls 8.2
success 8
trombone 8
military uniform 8
design 7.9
summer 7.7
style 7.4
symbol 7.4
photographer 7.4
back 7.3
new 7.3
businesswoman 7.3
tourist 7.2
sexy 7.2
sunset 7.2
worker 7.2
family 7.1
cool 7.1
happiness 7
architecture 7

Google
created on 2019-11-16

Microsoft
created on 2019-11-16

person 99.7
clothing 97.3
posing 95.4
woman 93
dress 89.6
dance 89.4
man 86
group 85.3
wedding dress 84.8
black and white 82.4
text 81.2
bride 81.2
smile 80.5
standing 80.2
people 59
musical instrument 57.4
old 40.5
crowd 0.7

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 35-51
Gender Female, 53.5%
Angry 45%
Confused 45%
Disgusted 45%
Happy 54.6%
Sad 45%
Fear 45%
Calm 45.3%
Surprised 45%

AWS Rekognition

Age 17-29
Gender Male, 52.4%
Disgusted 45.1%
Calm 46.6%
Surprised 45.2%
Fear 45.1%
Happy 52.7%
Confused 45.1%
Sad 45.1%
Angry 45.1%

AWS Rekognition

Age 34-50
Gender Male, 54.8%
Surprised 45.1%
Calm 54.4%
Fear 45%
Disgusted 45%
Happy 45.5%
Angry 45%
Sad 45%
Confused 45%

AWS Rekognition

Age 35-51
Gender Female, 55%
Sad 49.5%
Surprised 45.1%
Confused 45%
Angry 45.1%
Calm 45.3%
Fear 49.9%
Happy 45.1%
Disgusted 45%

AWS Rekognition

Age 23-35
Gender Female, 54.4%
Calm 45.4%
Disgusted 45.2%
Surprised 45.2%
Fear 45.1%
Happy 53.2%
Angry 45.6%
Confused 45.2%
Sad 45.1%

AWS Rekognition

Age 30-46
Gender Male, 54%
Surprised 45%
Fear 45%
Angry 45.1%
Happy 45%
Sad 45.1%
Confused 45%
Calm 54.8%
Disgusted 45%

AWS Rekognition

Age 21-33
Gender Female, 50.1%
Calm 48.3%
Sad 46%
Confused 45.5%
Happy 45.3%
Angry 47.3%
Disgusted 46.2%
Fear 45.8%
Surprised 45.6%

Microsoft Cognitive Services

Age 33
Gender Female

Microsoft Cognitive Services

Age 32
Gender Male

Microsoft Cognitive Services

Age 34
Gender Female

Microsoft Cognitive Services

Age 32
Gender Female

Microsoft Cognitive Services

Age 64
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%
Shoe 90.1%

Captions

Microsoft

a group of people standing in front of a crowd posing for the camera 92.7%
a group of people posing for a photo 92.6%
a group of people posing for a photo in front of a crowd 92.5%

Text analysis

Amazon

MJI3TAITIS ADA

Google

Mu 3TAITIM ATDA
Mu
3TAITIM
ATDA