Human Generated Data

Title

Untitled (man giving speech at podium)
Date

c. 1950
People

Artist: Jack Gould, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.15579.1

Human Generated Data

Title

Untitled (man giving speech at podium)

People

Artist: Jack Gould, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-05

Clothing 98.8
Apparel 98.8
Person 98.2
Human 98.2
Person 95.9
Overcoat 90.7
Coat 90.7
Poster 90.3
Advertisement 90.3
Shirt 75.9
Text 64.3
Suit 60.5
Face 60.3
Tuxedo 57.5
Photo 56.8
Photography 56.8
Portrait 56.8

Imagga
created on 2022-02-05

coat 39
lab coat 39
nurse 35.7
person 31.6
man 30.9
people 28.5
professional 27
adult 26.1
male 24.8
work 23.6
portrait 22.7
medical 21.2
business 20.7
businessman 20.3
lab 19.4
laboratory 19.3
office 18.5
clothing 18.1
looking 17.6
happy 16.9
smiling 16.6
worker 16.4
doctor 16
garment 15.6
chemistry 15.5
face 14.9
scientist 14.7
biology 14.2
job 14.2
health 13.9
men 13.7
room 13.7
serious 13.4
medicine 13.2
newspaper 13.1
smile 12.8
executive 12.8
student 12.8
employee 12.6
hospital 12.6
scholar 12.5
research 12.4
indoors 12.3
patient 12.3
senior 12.2
corporate 12
science 11.6
care 11.5
ruler 11.2
study 11.2
occupation 11
confident 10.9
chemical 10.6
gown 10.5
profession 10.5
education 10.4
mature 10.2
day 10.2
bright 10
intellectual 10
old 9.8
human 9.7
technology 9.7
test 9.6
businesspeople 9.5
one person 9.4
indoor 9.1
team 9
handsome 8.9
working 8.8
home 8.8
thoughtful 8.8
scientific 8.7
hair 8.7
standing 8.7
lifestyle 8.7
exam 8.6
happiness 8.6
development 8.6
manager 8.4
suit 8.4
successful 8.2
surgeon 8.2
clinic 7.9
experiment 7.8
analysis 7.8
color 7.8
sitting 7.7
reading 7.6
film 7.5
one 7.5
holding 7.4
focus 7.4
alone 7.3
group 7.3
success 7.2
building 7.2
women 7.1
negative 7.1
paper 7.1
look 7

Google
created on 2022-02-05

Black-and-white 84.1
Style 83.9
Plant 82
Font 81.9
Suit 75
Monochrome photography 73.9
Flag 72.3
Monochrome 72.3
White-collar worker 70.9
Event 70.4
Glass 67
Barware 61.7
Speech 58
Formal wear 55.6
Advertising 54.8
History 53.6
Tree 52.7
Transparent material 51.8

Microsoft
created on 2022-02-05

text 99.6
clothing 95.7
person 93.3
man 87.3
human face 85.2
black and white 72
suit 61

Face analysis

Amazon

Google

AWS Rekognition

Age 38-46
Gender Male, 79.3%
Sad 56.8%
Happy 15.4%
Confused 12.2%
Calm 5.5%
Surprised 3.6%
Disgusted 3.2%
Angry 2%
Fear 1.3%

AWS Rekognition

Age 36-44
Gender Female, 69.3%
Calm 80.2%
Surprised 16.9%
Fear 1.6%
Disgusted 0.5%
Angry 0.3%
Sad 0.2%
Confused 0.2%
Happy 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.2%
Poster 90.3%
Suit 60.5%

Captions

Microsoft

a man standing in front of a window 66.6%
a man that is standing in front of a window 62.9%
a man standing next to a window 55.5%

Text analysis

Amazon

BEFORE
EGGS
BEEF
POULTRY
OUIS
ORANGES
BREAD
OAST BEEF
DC
OAST
BACON
BUTTER
35
43
70%
15
MILK
SIT
30%
HAMBURGER
POULTRY Hens
WA
4
TIG
W
D'day
Hens
INDUSTA
3.6
4 K
K
II
-
50%
T II OUIS INDUSTA
НАТ
BREAD (16oz.)
BUTTER 00
T
(16oz.)
35%
Oil
00

Google

TIOUIS INDUSTA BEFORE OAST BEEF BACON HAMBURGER HAM BUTTER 50 15 MILK ORANGES POULTRY Hens 43 EGGS BREAD 6) 36 DC WA
HAM
BUTTER
MILK
ORANGES
WA
BEEF
BACON
HAMBURGER
50
POULTRY
BREAD
DC
INDUSTA
BEFORE
6)
15
Hens
EGGS
36
TIOUIS
OAST
43