Human Generated Data

Title

Untitled (two photographs: clegy members with girls in white dresses on steps; woman in cape and laurel wreath at piano)
Date

c. 1935, printed later
People

Artist: Durette Studio, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.6099

Human Generated Data

Title

Untitled (two photographs: clegy members with girls in white dresses on steps; woman in cape and laurel wreath at piano)

People

Artist: Durette Studio, American 20th century

Date

c. 1935, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-11-16

Person 98.7
Human 98.7
Person 97.8
Person 96.7
Advertisement 92.7
Collage 92.7
Clothing 92.2
Apparel 92.2
Poster 90.9
Person 87.6
Display 83.5
Monitor 83.5
Electronics 83.5
Screen 83.5
Person 81.9
Interior Design 80.2
Indoors 80.2
Person 78.9
Person 77.4
Person 76.3
Suit 67.2
Overcoat 67.2
Coat 67.2
Person 65.9
Person 64.8
Shop 62.2
Room 58
Person 48.6

Clarifai
created on 2019-11-16

people 99.7
monochrome 99
adult 95.7
man 95.6
group 92.6
woman 92.4
one 89.4
two 88.8
wear 88.1
art 85.9
child 85.4
room 84.4
furniture 84.1
street 83.7
vehicle 82.7
portrait 82.6
collage 81.2
music 78.4
window 78.2
war 77.7

Imagga
created on 2019-11-16

black 19.8
sax 18.6
man 18.1
male 17
negative 15.9
people 15.6
silhouette 14.9
musical instrument 14.7
business 12.8
building 12.1
film 12.1
grand piano 11.6
light 11.4
piano 11.3
men 11.2
stringed instrument 11
wind instrument 10.8
device 10.4
architecture 10.1
person 10.1
percussion instrument 9.7
window 9.4
old 9.1
brass 9
keyboard instrument 8.9
glass 8.8
businessman 8.8
photographic paper 8.6
art 8.5
hand 8.4
bass 8.2
office 8.2
music 8.2
worker 8.2
equipment 8.1
symbol 8.1
working 8
adult 7.8
cornet 7.7
instrument 7.7
bride 7.7
city 7.5
blackboard 7.4
religion 7.2
history 7.2
work 7.1

Google
created on 2019-11-16

Photograph 96.9
Photographic paper 93.1
Snapshot 86.6
Black-and-white 84.2
Room 81.5
Photography 80.2
Picture frame 73.6
Stock photography 65.4
Art 58.1
Monochrome photography 57.8
Darkroom 56.4

Microsoft
created on 2019-11-16

text 98.8
clothing 95.9
person 95.9
black and white 90.1
man 72
wedding dress 56.3
image 38.6
set 25.9

Face analysis

Amazon

AWS Rekognition

Age 23-35
Gender Female, 54.4%
Fear 45.2%
Surprised 45.1%
Angry 45.2%
Sad 45.3%
Disgusted 45.2%
Happy 53.2%
Calm 45.5%
Confused 45.4%

AWS Rekognition

Age 51-69
Gender Male, 54.8%
Angry 48%
Happy 45%
Disgusted 45.3%
Calm 46.9%
Fear 45.5%
Surprised 45.2%
Sad 47.1%
Confused 47.1%

AWS Rekognition

Age 25-39
Gender Female, 50.2%
Confused 49.5%
Angry 50.4%
Surprised 49.5%
Calm 49.5%
Disgusted 49.5%
Fear 49.5%
Sad 49.5%
Happy 49.5%

AWS Rekognition

Age 29-45
Gender Male, 50.4%
Confused 49.9%
Surprised 49.5%
Happy 49.5%
Sad 49.6%
Disgusted 49.5%
Angry 49.5%
Calm 49.9%
Fear 49.5%

AWS Rekognition

Age 17-29
Gender Female, 50.3%
Disgusted 49.5%
Calm 50.3%
Confused 49.5%
Sad 49.6%
Happy 49.6%
Angry 49.5%
Fear 49.5%
Surprised 49.5%

AWS Rekognition

Age 13-23
Gender Female, 50.3%
Fear 49.5%
Happy 49.5%
Confused 49.6%
Calm 49.8%
Disgusted 49.5%
Sad 49.9%
Angry 49.7%
Surprised 49.5%

AWS Rekognition

Age 23-35
Gender Male, 50.2%
Confused 49.5%
Sad 49.5%
Happy 50%
Angry 49.5%
Fear 49.5%
Disgusted 49.5%
Calm 49.9%
Surprised 49.5%

AWS Rekognition

Age 23-37
Gender Female, 50%
Disgusted 49.6%
Calm 49.7%
Surprised 49.5%
Fear 49.7%
Happy 49.6%
Confused 49.5%
Sad 49.8%
Angry 49.5%

AWS Rekognition

Age 21-33
Gender Female, 50.5%
Surprised 49.6%
Angry 49.5%
Happy 49.6%
Fear 49.9%
Calm 49.6%
Disgusted 49.6%
Sad 49.6%
Confused 49.6%

AWS Rekognition

Age 26-40
Gender Female, 50.2%
Surprised 49.6%
Disgusted 49.8%
Sad 49.6%
Angry 49.6%
Calm 49.5%
Happy 49.7%
Fear 49.7%
Confused 49.5%

AWS Rekognition

Age 57-75
Gender Male, 50.6%
Disgusted 45%
Happy 53.1%
Angry 45.4%
Calm 46.3%
Surprised 45.1%
Confused 45%
Sad 45%
Fear 45%

AWS Rekognition

Age 19-31
Gender Female, 50.3%
Fear 49.6%
Calm 49.6%
Angry 50%
Happy 49.6%
Confused 49.5%
Disgusted 49.6%
Sad 49.6%
Surprised 49.5%

AWS Rekognition

Age 11-21
Gender Female, 50.4%
Disgusted 49.5%
Happy 49.5%
Angry 49.6%
Fear 49.6%
Sad 50%
Surprised 49.5%
Confused 49.5%
Calm 49.8%

AWS Rekognition

Age 13-23
Gender Female, 50.1%
Surprised 49.6%
Happy 49.5%
Sad 49.6%
Fear 49.7%
Calm 49.6%
Confused 49.5%
Disgusted 49.5%
Angry 50%

AWS Rekognition

Age 52-70
Gender Male, 50.4%
Angry 49.5%
Sad 49.6%
Calm 49.5%
Disgusted 49.5%
Confused 49.5%
Surprised 49.6%
Fear 50.2%
Happy 49.6%

AWS Rekognition

Age 34-50
Gender Male, 50.4%
Calm 50.1%
Surprised 49.5%
Disgusted 49.8%
Happy 49.5%
Angry 49.5%
Confused 49.5%
Sad 49.6%
Fear 49.5%

AWS Rekognition

Age 12-22
Gender Female, 50.2%
Angry 49.5%
Surprised 49.5%
Confused 49.5%
Disgusted 49.5%
Sad 49.5%
Happy 50.3%
Calm 49.5%
Fear 49.5%

AWS Rekognition

Age 18-30
Gender Male, 50%
Sad 49.5%
Calm 49.5%
Angry 49.5%
Fear 49.6%
Happy 49.5%
Surprised 49.9%
Disgusted 49.6%
Confused 49.8%

AWS Rekognition

Age 28-44
Gender Female, 50.5%
Disgusted 49.5%
Angry 49.5%
Calm 49.5%
Surprised 49.5%
Sad 49.5%
Confused 49.5%
Fear 49.5%
Happy 50.4%

AWS Rekognition

Age 18-30
Gender Female, 50%
Sad 49.6%
Disgusted 49.5%
Surprised 49.5%
Happy 49.5%
Angry 49.5%
Fear 49.5%
Confused 49.5%
Calm 50.3%

AWS Rekognition

Age 11-21
Gender Female, 50.2%
Disgusted 49.5%
Angry 49.5%
Fear 49.5%
Happy 49.5%
Confused 49.5%
Sad 50.3%
Calm 49.6%
Surprised 49.5%

AWS Rekognition

Age 25-39
Gender Female, 50.3%
Confused 49.6%
Surprised 49.5%
Fear 49.5%
Happy 49.5%
Disgusted 49.5%
Angry 49.6%
Sad 49.5%
Calm 50.3%

AWS Rekognition

Age 5-15
Gender Female, 50.5%
Disgusted 49.5%
Calm 49.5%
Confused 49.5%
Sad 49.5%
Happy 49.5%
Angry 49.5%
Fear 50.4%
Surprised 49.5%

AWS Rekognition

Age 13-25
Gender Female, 50.2%
Fear 49.5%
Disgusted 49.5%
Calm 50.1%
Happy 49.8%
Surprised 49.5%
Angry 49.5%
Sad 49.5%
Confused 49.5%

AWS Rekognition

Age 15-27
Gender Female, 50.3%
Surprised 49.5%
Sad 49.6%
Confused 49.5%
Happy 49.6%
Disgusted 49.5%
Fear 49.5%
Angry 49.7%
Calm 50.1%

AWS Rekognition

Age 23-35
Gender Female, 50.3%
Confused 49.5%
Angry 49.6%
Surprised 49.5%
Calm 49.8%
Disgusted 50%
Fear 49.5%
Sad 49.5%
Happy 49.5%

AWS Rekognition

Age 24-38
Gender Male, 50.2%
Fear 49.5%
Happy 49.5%
Confused 49.5%
Calm 49.5%
Disgusted 49.5%
Sad 49.5%
Angry 50.4%
Surprised 49.5%

AWS Rekognition

Age 34-50
Gender Male, 50.1%
Disgusted 49.5%
Happy 49.6%
Angry 49.5%
Fear 49.5%
Calm 49.5%
Confused 49.5%
Surprised 49.5%
Sad 50.4%

AWS Rekognition

Age 10-20
Gender Female, 50.5%
Angry 49.6%
Happy 49.5%
Fear 49.6%
Disgusted 49.5%
Sad 49.6%
Calm 49.9%
Surprised 49.5%
Confused 49.7%

AWS Rekognition

Age 34-50
Gender Female, 50.4%
Calm 49.9%
Surprised 49.8%
Disgusted 49.7%
Happy 49.6%
Angry 49.5%
Confused 49.5%
Sad 49.5%
Fear 49.5%

AWS Rekognition

Age 22-34
Gender Female, 50.2%
Happy 49.5%
Surprised 49.5%
Angry 49.5%
Fear 49.5%
Sad 49.5%
Confused 49.6%
Calm 50.2%
Disgusted 49.5%

Feature analysis

Amazon

Person 98.7%
Poster 90.9%
Monitor 83.5%

Captions

Microsoft

a screen shot of a person 56.9%
a screen shot of a social media photo of a person 49.6%

Text analysis

Google

G
G