Human Generated Data

Title

Untitled (advertising executives on "White Tower" account)

Date

1951

People

Artist: Peter James Studio, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.20115

Human Generated Data

Title

Untitled (advertising executives on "White Tower" account)

People

Artist: Peter James Studio, American

Date

1951

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Clothing 99.2
Apparel 99.2
Person 99.1
Human 99.1
Person 98.4
Person 97.8
Person 97.5
Person 96.1
Tie 92.1
Accessory 92.1
Accessories 92.1
Coat 84.2
Shirt 82.3
Lab Coat 73.1
Lab 71.9
Clinic 66.4
Suit 62
Overcoat 62
Scientist 56.3
Dress Shirt 55.2

Imagga
created on 2022-03-05

office 48.7
desk 42.9
man 41.7
computer 39.6
business 38.3
male 36.2
businessman 34.4
people 33.5
table 33.5
professional 33.1
person 32
laptop 32
working 30.9
work 29.8
adult 26.1
corporate 25.8
job 25.7
sitting 24.9
smiling 24.6
happy 24.4
lab coat 24.4
coat 21.9
businesswoman 21.8
worker 21.7
executive 21.3
group 21
smile 19.2
men 18.9
meeting 18.8
suit 18.1
businesspeople 18
team 17.9
home 17.6
workplace 17.2
technology 17.1
indoors 16.7
successful 16.5
looking 16
communication 15.1
manager 14.9
colleagues 14.6
success 14.5
keyboard 14.1
notebook 14
teamwork 13.9
occupation 13.8
casual 13.6
modern 13.3
mature 13
patient 13
room 13
confident 12.7
monitor 12.4
portrait 12.3
clothing 12.2
attractive 11.9
women 11.9
lifestyle 11.6
medical 11.5
career 11.4
furniture 11.3
doctor 11.3
house 10.9
hospital 10.9
coworkers 10.8
specialist 10.7
education 10.4
senior 10.3
garment 10.3
presentation 10.2
happiness 10.2
horizontal 10.1
associates 9.8
conference 9.8
two 9.3
screen 9.2
teacher 9.2
indoor 9.1
hand 9.1
board 9
human 9
handsome 8.9
together 8.8
partners 8.7
partner 8.7
clinic 8.6
document 8.6
expression 8.5
health 8.3
20s 8.2
employee 8.2
cheerful 8.1
paper 7.8
colleague 7.8
businessperson 7.8
consultant 7.8
cooperation 7.7
corporation 7.7
boss 7.7
sit 7.6
pen 7.6
kitchen 7.4
coffee 7.4
alone 7.3

Google
created on 2022-03-05

Microsoft
created on 2022-03-05

text 99
wall 96.9
man 95.5
clothing 93.2
person 89.8
indoor 89.3
table 35.5
worktable 18.4

Face analysis

Amazon

Google

AWS Rekognition

Age 48-56
Gender Male, 97.8%
Calm 100%
Surprised 0%
Sad 0%
Fear 0%
Disgusted 0%
Confused 0%
Angry 0%
Happy 0%

AWS Rekognition

Age 28-38
Gender Male, 99.7%
Calm 64.2%
Surprised 18.1%
Happy 11.2%
Angry 1.9%
Sad 1.8%
Fear 1.1%
Disgusted 0.9%
Confused 0.8%

AWS Rekognition

Age 26-36
Gender Male, 99.8%
Calm 99.9%
Sad 0%
Confused 0%
Happy 0%
Disgusted 0%
Surprised 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 45-51
Gender Male, 99.9%
Happy 98.8%
Sad 0.6%
Surprised 0.2%
Disgusted 0.1%
Fear 0.1%
Confused 0.1%
Calm 0.1%
Angry 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%
Tie 92.1%

Captions

Microsoft

a person standing in front of a store 78.8%
a man and a woman standing in front of a counter 76.5%
a man and a woman standing in front of a store 58.5%

Text analysis

Amazon

GEO
GOODMAN
WROW
MUSICA
MICHAELS
Show
F
Feller
WHITE
ART
ART FORD'S
FORD'S
Sherm Feller
SENNY GOODMAN NITE
Sherm
NITE
WHITE TOWER
MEN
SENNY
TOWER
WCOP
will GEO MICHAELS
WHITE lower
WHITE ОШЕН
lower
WA
-
ОШЕН
Espiny -
will
Espiny
ГАФ
DRIF
YTЭЗ-
MILEMAR

Google

Cy he WHITE IOWER MUSIC ME GEO MICHAELS WROW WHITE IOWER NCOP Shem Feller Show SENNY GOODMAN HITE PART FORD'S
MUSIC
HITE
IOWER
Shem
PART
FORD'S
he
ME
Feller
GOODMAN
WHITE
GEO
NCOP
Show
SENNY
Cy
MICHAELS
WROW