Human Generated Data

Title

Untitled (group of men in room on chairs, eating)

Date

1958

People

Artist: Peter James Studio, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.20104

Human Generated Data

Title

Untitled (group of men in room on chairs, eating)

People

Artist: Peter James Studio, American

Date

1958

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Human 99.5
Person 99.5
Person 98.8
Clinic 98.3
Person 98.2
Person 98
Person 97.5
Person 97.4
Person 96.1
Person 94
Indoors 86.9
Person 86.5
Room 84.2
Operating Theatre 84.1
Hospital 84.1
Person 82
Interior Design 79.7
Person 79.6
Person 76.1
Person 73.6
Person 73.6
Person 71.4
People 66.4
Person 64
Doctor 63.8
Person 63
Crowd 60
Furniture 58.5
Chair 58.5
Surgery 57.9
Lighting 57.2

Imagga
created on 2022-03-05

brass 55.4
wind instrument 46.1
man 34.3
people 33.5
musical instrument 33.4
businessman 29.1
group 28.2
business 27.3
meeting 27.3
person 26.9
male 24.8
team 24.2
professional 23.9
office 22.6
corporate 22.3
men 21.5
adult 21.4
table 20.8
communication 20.1
cornet 18.8
room 18.8
trombone 18.6
teamwork 18.5
businesswoman 18.2
work 18
executive 17.7
teacher 17.5
success 16.9
interior 15.9
women 15.8
modern 15.4
talking 15.2
businesspeople 15.2
chair 15.1
indoors 14.9
couple 14.8
indoor 14.6
job 14.1
horn 14
happy 13.8
conference 13.7
desk 13.2
manager 13
education 13
device 12.8
worker 12.8
smiling 12.3
together 12.3
suit 11.7
concert 11.6
life 11.5
lifestyle 10.8
music 10.6
sitting 10.3
presentation 10.2
musician 10.2
board 9.9
student 9.8
restaurant 9.8
boss 9.6
furniture 9.5
light 9.4
finance 9.3
phone 9.2
successful 9.1
employee 9.1
laptop 9.1
educator 9.1
handsome 8.9
seminar 8.8
hall 8.8
computer 8.8
stage 8.8
home 8.8
happiness 8.6
microphone 8.4
design 8.4
portrait 8.4
study 8.4
training 8.3
occupation 8.2
working 8
smile 7.8
chairs 7.8
hands 7.8
partners 7.8
colleagues 7.8
classroom 7.7
oboe 7.7
partner 7.7
class 7.7
collar 7.7
holding 7.4
instrumentality 7.4
confident 7.3
dress 7.2
outfit 7.2
singer 7.2

Google
created on 2022-03-05

Coat 90.5
Black 89.6
Black-and-white 86.3
Style 84.1
Suit 82.4
Line 81.7
Monochrome 77.8
Monochrome photography 76.4
Snapshot 74.3
T-shirt 74
Event 73.6
Room 67.7
Font 66.2
Stock photography 64.8
Crowd 62.5
Team 59.5
Photography 52.2
Ceiling 51.2

Microsoft
created on 2022-03-05

text 96.2
person 95.2
clothing 86
player 76.5
man 66.6
posing 57.9

Face analysis

Amazon

Google

AWS Rekognition

Age 25-35
Gender Male, 99.1%
Calm 99.1%
Confused 0.2%
Sad 0.2%
Happy 0.1%
Surprised 0.1%
Disgusted 0.1%
Angry 0.1%
Fear 0%

AWS Rekognition

Age 39-47
Gender Male, 99.7%
Calm 99.9%
Sad 0.1%
Confused 0%
Disgusted 0%
Angry 0%
Surprised 0%
Happy 0%
Fear 0%

AWS Rekognition

Age 35-43
Gender Male, 55%
Calm 84.7%
Sad 11.5%
Happy 2.7%
Confused 0.4%
Angry 0.4%
Disgusted 0.2%
Surprised 0.1%
Fear 0.1%

AWS Rekognition

Age 33-41
Gender Male, 79%
Sad 71.5%
Happy 20.3%
Calm 3.7%
Confused 1.5%
Surprised 1.3%
Disgusted 1%
Angry 0.4%
Fear 0.3%

AWS Rekognition

Age 45-51
Gender Male, 67.9%
Calm 99.6%
Sad 0.2%
Confused 0%
Angry 0%
Happy 0%
Surprised 0%
Disgusted 0%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Feature analysis

Amazon

Person 99.5%

Captions

Microsoft

a group of people posing for a photo 93.1%
a group of people posing for the camera 93%
a group of people posing for a picture 92.9%

Text analysis

Amazon

FILM
SAFETY FILM
SAFETY
KODAK

Google

FILM
SAFETY
KODAK SAFETY FILM
KODAK