Human Generated Data

Title

Untitled (six men being sworn-in during official ceremony)
Date

c. 1950
People

Artist: Jack Gould, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.14721

Human Generated Data

Title

Untitled (six men being sworn-in during official ceremony)

People

Artist: Jack Gould, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-29

Human 99.2
Person 99.2
Person 99.2
Person 99
Person 98.9
Person 98.7
Person 98.6
Person 98.4
Clinic 97.5
Person 83.9
Doctor 79.1
Hospital 76.9
Electronics 76.1
Computer 76.1
Laptop 76.1
Pc 76.1
Operating Theatre 73.2
People 70.1
Person 68.7
Indoors 60.8
Room 59.8

Imagga
created on 2022-01-29

nurse 63.4
man 47.1
businessman 43.3
male 42.6
people 40.8
adult 39.2
businesswoman 39.1
business 38.3
office 37.2
businesspeople 37.1
professional 37.1
person 36.9
meeting 34
working 33.6
team 33.2
colleagues 31.1
room 30.4
computer 29.7
group 29.1
desk 28.5
indoors 26.4
teamwork 26
indoor 24.7
happy 24.5
sitting 23.2
table 22.6
teacher 22.6
work 22
laptop 21.9
talking 21.9
worker 21.8
smiling 21.7
executive 21.5
corporate 21.5
together 21.1
associates 19.7
men 18.9
coworkers 18.7
20s 18.4
women 17.4
clinic 17.3
casual 17
classroom 16.9
job 16.8
portrait 16.2
face 15.6
40s 15.6
discussion 15.6
30s 15.4
four 15.4
educator 14.8
conference 14.7
cheerful 14.6
lifestyle 14.5
patient 14.4
horizontal 14.3
hospital 13.7
successful 13.7
looking 13.6
home 13.6
coat 13.4
employee 13.2
couple 13.1
manager 13.1
mature 13
camera 13
smile 12.8
cooperation 12.6
practitioner 12.4
lab coat 12.3
modern 11.9
attractive 11.9
confident 11.8
communication 11.8
businessmen 11.7
color 11.7
medical 11.5
doctor 11.3
student 11.3
education 11.3
happiness 11
boardroom 10.9
business people 10.9
collaboration 10.8
explaining 10.8
crew 10.8
discussing 10.8
handsome 10.7
workplace 10.5
success 10.5
career 10.4
technology 10.4
company 10.2
day 10.2
occupation 10.1
suit 9.9
25 30 years 9.8
interior 9.7
mid adult 9.7
busy 9.7
boss 9.6
ethnic 9.5
females 9.5
two 9.3
four people 8.9
thirties 8.8
clothing 8.7
jacket 8.7
staff 8.6
twenties 8.6
bright 8.6
specialist 8.5
document 8.4
pretty 8.4
presentation 8.4
holding 8.3
multi ethnic group 7.9
forties 7.9
colleague 7.8
listening 7.7
employment 7.7
corporation 7.7
leader 7.7
health 7.7
learning 7.5
human 7.5
care 7.4
new 7.3

Google
created on 2022-01-29

Black-and-white 83.8
Font 81
Adaptation 79.2
Art 76.5
Window 74.5
Monochrome photography 72
Monochrome 70.8
Event 70.8
History 67
Room 66.1
Vintage clothing 64.9
Illustration 63
Stock photography 62.4
Uniform 61.2
Urban design 58.9
Team 58.4
Paper product 53.7
Visual arts 52.6

Microsoft
created on 2022-01-29

person 97.3
text 83.2
table 81.7
clothing 75.6
house 67.8
furniture 64.2
group 57.3

Face analysis

Amazon

Google

AWS Rekognition

Age 47-53
Gender Male, 99.8%
Calm 49.7%
Confused 26.5%
Sad 16.9%
Happy 3.6%
Angry 1.1%
Disgusted 1%
Surprised 0.6%
Fear 0.6%

AWS Rekognition

Age 49-57
Gender Female, 95.3%
Calm 92.7%
Surprised 3.2%
Sad 2.8%
Confused 0.4%
Disgusted 0.3%
Angry 0.3%
Happy 0.2%
Fear 0.1%

AWS Rekognition

Age 30-40
Gender Male, 72.3%
Calm 99.6%
Confused 0.2%
Sad 0.2%
Surprised 0%
Happy 0%
Disgusted 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 36-44
Gender Female, 96.1%
Calm 68.6%
Sad 16.3%
Happy 7.3%
Disgusted 2.3%
Confused 2.2%
Fear 1.6%
Surprised 0.9%
Angry 0.7%

AWS Rekognition

Age 16-24
Gender Female, 70.4%
Calm 65.5%
Happy 20%
Sad 7.6%
Confused 2.6%
Angry 1.4%
Fear 1.3%
Surprised 0.9%
Disgusted 0.8%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%
Laptop 76.1%

Captions

Microsoft

a group of people standing around a table 91.3%
a group of people standing in front of a window 80.7%
a group of people standing in front of a box 80.6%

Text analysis

Amazon

3
MJI7
MJI7 YT33AS ACHA
YT33AS
ACHA

Google

YT3RA2
A
MJI7 YT3RA2 A
MJI7