Human Generated Data

Title

Untitled (two photographs: studio portrait of two boys in suits with ribbons around arms; studio portrait of smiling woman in fur coat carrying purse)
Date

c. 1935, printed later
People

Artist: Durette Studio, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.6093

Human Generated Data

Title

Untitled (two photographs: studio portrait of two boys in suits with ribbons around arms; studio portrait of smiling woman in fur coat carrying purse)

People

Artist: Durette Studio, American 20th century

Date

c. 1935, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-11-16

Apparel 99.9
Clothing 99.9
Overcoat 97.9
Human 97.8
Person 97.8
Person 97.5
Person 95.2
Coat 92.9
Shoe 91.5
Footwear 91.5
Suit 77.4
Sleeve 66.8
Pants 55.7
Shoe 54.5

Clarifai
created on 2019-11-16

people 99.8
woman 97.9
adult 97.4
wear 96.9
man 96.8
group 96.3
portrait 95.5
collection 92.7
two 91.6
outfit 88.8
fashion 87.5
movie 86.6
dress 86.6
model 86.3
room 82.8
three 79.1
child 78
music 78
actress 77.9
actor 77.6

Imagga
created on 2019-11-16

people 29
man 28.9
coat 28.7
black 28.3
business 27.9
fur coat 26.2
outfit 24.6
clothing 23
fashion 21.1
urban 21
person 20.5
city 19.9
male 19.9
men 19.7
businessman 19.4
adult 18.9
garment 18.5
suit 18.1
office 17
attractive 16.8
women 16.6
corporate 16.3
group 16.1
walk 15.2
silhouette 14.9
crowd 14.4
model 14
executive 13.3
window 13.1
street 12.9
standing 12.2
shopping 11.9
architecture 11.7
interior 11.5
professional 11.5
walking 11.4
success 11.3
modern 11.2
building 11.1
portrait 11
work 11
pretty 10.5
couple 10.4
two 10.2
life 10.1
elegance 10.1
light 10
posing 9.8
mall 9.7
bag 9.6
motion 9.4
cute 9.3
holding 9.1
dress 9
briefcase 9
team 9
looking 8.8
elegant 8.6
musical instrument 8.5
stand 8.5
outdoor 8.4
manager 8.4
occupation 8.2
indoor 8.2
one 8.2
sexy 8
singer 7.9
scene 7.8
glass 7.8
performer 7.8
happy 7.5
human 7.5
outdoors 7.5
musician 7.4
pose 7.2
figure 7.2
lifestyle 7.2
handsome 7.1
smile 7.1

Google
created on 2019-11-16

Photograph 96.1
Black-and-white 88.5
Snapshot 82
Picture frame 82
Photography 74.8
Art 72.1
Room 65.7
Monochrome 64.3
Gentleman 63.5
Visual arts 62.5
Stock photography 59.4
Monochrome photography 57.8
Style 54.3
Photographic paper 51.4

Microsoft
created on 2019-11-16

text 97.9
gallery 96.8
black and white 96.7
clothing 96.5
person 96.4
coat 95.9
standing 95.3
posing 94.2
street 91.7
room 91.7
jacket 88.9
scene 88.7
footwear 86.5
suit 80.1
drawing 79.3
man 73.2
monochrome 68.7
black 65.3
old 63.8
smile 63.2
picture frame 12.4

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 12-22
Gender Male, 54.1%
Happy 45%
Disgusted 45%
Fear 45%
Calm 54.7%
Angry 45%
Confused 45%
Sad 45.1%
Surprised 45.1%

AWS Rekognition

Age 15-27
Gender Female, 54.2%
Angry 45.5%
Happy 45.1%
Disgusted 45%
Calm 54%
Fear 45.1%
Surprised 45.1%
Sad 45.1%
Confused 45.1%

AWS Rekognition

Age 19-31
Gender Female, 54.9%
Calm 45.1%
Confused 45.1%
Happy 53.9%
Disgusted 45.1%
Surprised 45.2%
Sad 45%
Fear 45.2%
Angry 45.4%

Microsoft Cognitive Services

Age 25
Gender Male

Microsoft Cognitive Services

Age 45
Gender Female

Microsoft Cognitive Services

Age 30
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.8%
Coat 92.9%
Shoe 91.5%

Captions

Microsoft

Tad Lincoln et al. standing in front of a window posing for the camera 84.8%
a person standing in front of Tad Lincoln et al. posing for a photo 83%
Tad Lincoln et al. standing in front of a window posing for the camera 79.9%