Human Generated Data

Title

Untitled (group portrait of thirteen adults and one baby inside living room)
Date

c. 1950
People

Artist: Jack Rodden Studio, American 1914 - 2016
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.13454

Human Generated Data

Title

Untitled (group portrait of thirteen adults and one baby inside living room)

People

Artist: Jack Rodden Studio, American 1914 - 2016

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-30

Human 99.6
Person 99.6
Person 99.4
Person 99.2
Person 98.2
Person 95.7
Person 95.5
Person 94.9
Person 94.6
Person 94.5
Person 94.4
Person 93.5
Person 93.3
Indoors 93
Interior Design 93
Apparel 92.1
Clothing 92.1
Shorts 84.8
Person 70
People 69.8
Advertisement 69.8
Meal 65.3
Food 65.3
Crowd 65.1
Screen 64.8
Electronics 64.8
Monitor 64.8
Display 64.8
Poster 63.4
Face 62.6
Leisure Activities 61.6
Collage 59.7
Stage 59.6
Text 59.1
Pedestrian 58
Musician 55.6
Musical Instrument 55.6
Art 55

Imagga
created on 2022-01-30

blackboard 53.6
x-ray film 27.9
film 27.2
people 26.7
person 20
silhouette 19.8
man 18.8
stage 18.6
male 18.4
photographic paper 18.1
classroom 17.3
crowd 17.3
business 17
black 16.8
men 16.3
freight car 15.5
group 14.5
adult 14.4
event 13.9
hand 13.7
grunge 13.6
car 13.5
party 12.9
platform 12.7
room 12.5
design 12.4
equipment 12.2
education 12.1
photographic equipment 12
class 11.6
women 11.1
board 11
music 10.8
businessman 10.6
art 10.5
human 10.5
style 10.4
wheeled vehicle 10.3
symbol 10.1
hands 9.5
school 9.1
portrait 9.1
player 8.7
teacher 8.5
dark 8.3
student 8.3
one 8.2
team 8.1
chalkboard 7.8
audience 7.8
model 7.8
drawing 7.7
dance 7.7
disco 7.7
modern 7.7
attractive 7.7
fashion 7.5
sign 7.5
happy 7.5
entertainment 7.4
light 7.3
lady 7.3
graphic 7.3
dirty 7.2
body 7.2
vehicle 7.2
smile 7.1
working 7.1

Google
created on 2022-01-30

Rectangle 85.7
Font 82.2
Adaptation 79.3
Picture frame 76.1
Monochrome photography 73.6
Monochrome 72.1
Room 70
Event 67
Visual arts 65.7
Suit 65.1
Art 64.2
Display device 63.6
Stock photography 61.7
History 59.4
Photographic paper 58.7
Team 54.3
Photo caption 50.7

Microsoft
created on 2022-01-30

text 98.9
person 97.8
clothing 92
concert 90.7
group 56.9
old 46

Face analysis

Amazon

Google

AWS Rekognition

Age 25-35
Gender Male, 91%
Calm 97.9%
Sad 1.8%
Happy 0.1%
Fear 0.1%
Confused 0%
Surprised 0%
Angry 0%
Disgusted 0%

AWS Rekognition

Age 42-50
Gender Male, 87.5%
Happy 98.6%
Calm 0.6%
Angry 0.2%
Surprised 0.2%
Fear 0.1%
Sad 0.1%
Confused 0.1%
Disgusted 0.1%

AWS Rekognition

Age 43-51
Gender Male, 99.5%
Calm 68.6%
Happy 28.1%
Surprised 1.2%
Sad 1.1%
Disgusted 0.5%
Confused 0.2%
Fear 0.2%
Angry 0.1%

AWS Rekognition

Age 33-41
Gender Male, 99.6%
Sad 65.9%
Calm 10.9%
Happy 9.8%
Confused 9.3%
Disgusted 1.8%
Angry 1.2%
Surprised 0.5%
Fear 0.5%

AWS Rekognition

Age 33-41
Gender Male, 89.4%
Calm 99.7%
Sad 0.1%
Surprised 0.1%
Angry 0%
Confused 0%
Disgusted 0%
Happy 0%
Fear 0%

AWS Rekognition

Age 21-29
Gender Female, 84.9%
Calm 91%
Fear 4.3%
Happy 2.2%
Sad 0.8%
Confused 0.6%
Surprised 0.5%
Disgusted 0.4%
Angry 0.2%

AWS Rekognition

Age 45-53
Gender Male, 98.9%
Calm 75.9%
Sad 19.5%
Happy 2.5%
Surprised 0.8%
Confused 0.5%
Disgusted 0.3%
Angry 0.3%
Fear 0.3%

AWS Rekognition

Age 27-37
Gender Male, 88.3%
Calm 52.8%
Happy 25.7%
Sad 13.8%
Angry 2.7%
Confused 2.1%
Fear 1.2%
Disgusted 1%
Surprised 0.8%

AWS Rekognition

Age 45-51
Gender Male, 97.1%
Sad 91.9%
Calm 3.2%
Surprised 1.9%
Disgusted 0.9%
Happy 0.7%
Angry 0.6%
Fear 0.5%
Confused 0.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%

Captions

Microsoft

a group of people posing for a photo 84.6%
a group of people standing in front of a building 83.9%
a group of people standing in front of a window 76.1%

Text analysis

Amazon

KODAK-SVEETA

Google

KODVR
KODVR