Human Generated Data

Title

Untitled (people sitting on couches, smoking)

Date

c. 1950

People

Artist: Bachrach Studios, founded 1868

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.18964

Human Generated Data

Title

Untitled (people sitting on couches, smoking)

People

Artist: Bachrach Studios, founded 1868

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Person 99.5
Human 99.5
Person 99.3
Clothing 98.5
Apparel 98.5
Person 98.4
Furniture 90.9
Indoors 88.1
Room 88.1
Person 87.6
Female 75.6
Coat 74.8
Suit 74.8
Overcoat 74.8
People 69.7
Living Room 68.8
Table 68.5
Plant 68.2
Blossom 65.9
Flower 65.9
Sitting 65.7
Woman 61.3
Leisure Activities 61.1
Bed 60.5
Gown 57.3
Fashion 57.3
Bedroom 56.6
Pc 55.8
Electronics 55.8
Computer 55.8
Flower Arrangement 55.5
Clinic 55.1

Imagga
created on 2022-03-05

salon 38.4
man 38.3
person 36.2
male 32.7
people 31.8
computer 30.6
adult 29.5
office 28.3
home 27.9
sitting 27.5
indoors 26.4
laptop 26
business 25.5
table 23.7
professional 23.6
desk 23.1
work 22.1
happy 21.9
businessman 21.2
smiling 21
teacher 20.8
men 19.7
grand piano 19.6
job 19.5
smile 18.5
women 18.2
lifestyle 17.3
meeting 17
senior 16.9
mature 16.7
chair 16.5
piano 16.3
looking 16
communication 16
musical instrument 15.9
notebook 15.2
working 15
worker 14.7
education 14.7
cheerful 14.6
indoor 14.6
stringed instrument 14.5
two 14.4
room 14.1
technology 14.1
percussion instrument 13.8
handsome 13.4
couple 13.1
casual 12.7
team 12.5
executive 12.5
workplace 12.4
together 12.3
patient 12.2
group 12.1
corporate 12
phone 12
modern 11.9
happiness 11.8
keyboard instrument 11.7
suit 11.7
businesspeople 11.4
keyboard 11.3
portrait 11
businesswoman 10.9
mid adult 10.6
classroom 10.6
hairdresser 10.5
teamwork 10.2
life 10.1
house 10
attractive 9.8
interior 9.7
colleagues 9.7
talking 9.5
adults 9.5
learning 9.4
student 9.3
educator 9.1
confident 9.1
pretty 9.1
two people 8.7
boy 8.7
30s 8.7
reading 8.6
sit 8.5
manager 8.4
color 8.3
kin 8.3
clothing 8.3
successful 8.2
relaxing 8.2
nurse 8.1
kitchen 8.1
teaching 7.8
class 7.7
busy 7.7
retirement 7.7
exam 7.7
enjoying 7.6
career 7.6
friends 7.5
screen 7.5
mother 7.3
furniture 7.2
success 7.2
board 7.2
cup 7.2
family 7.1
to 7.1
child 7

Google
created on 2022-03-05

Microsoft
created on 2022-03-05

text 98.9
person 87.7
clothing 80.4
man 56.2
posing 48.3

Face analysis

Amazon

Google

AWS Rekognition

Age 39-47
Gender Male, 99.7%
Calm 96.1%
Happy 3.2%
Sad 0.2%
Angry 0.1%
Confused 0.1%
Disgusted 0.1%
Surprised 0.1%
Fear 0.1%

AWS Rekognition

Age 50-58
Gender Male, 72.4%
Surprised 43.3%
Calm 40.7%
Happy 4.7%
Confused 4.3%
Sad 3.2%
Angry 2%
Disgusted 1.4%
Fear 0.5%

AWS Rekognition

Age 14-22
Gender Male, 65.3%
Angry 55.7%
Calm 22.8%
Surprised 14%
Sad 2.4%
Disgusted 1.9%
Confused 1.7%
Fear 0.8%
Happy 0.7%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%

Captions

Microsoft

a group of people posing for the camera 75.9%
a group of people posing for a photo 70.2%
a group of people posing for a picture 70.1%

Text analysis

Amazon

KODAK
KODAK SAFETY FILM
FILM
SAFETY
E
8
N
: 8 8 N
:

Google

//
0
FILM
// 0 8:8 KODAK SAFETY FILM
8:8
KODAK
SAFETY