Human Generated Data

Title

Untitled (group portrait of employees)

Date

c. 1950

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16567

Human Generated Data

Title

Untitled (group portrait of employees)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-12

Human 99
Person 99
Person 98.8
Person 98.7
Person 98.7
Person 98.6
Person 98.3
Person 98.2
Person 98.1
Clothing 97.9
Apparel 97.9
Person 97.8
Person 97.1
Person 96.7
Tarmac 95.9
Asphalt 95.9
Person 93.6
Shorts 92.8
Road 87.6
Pedestrian 86.1
Person 83.6
Person 70.3
Overcoat 69.7
Coat 69.7
Suit 69.7
People 66.8
Portrait 61.5
Face 61.5
Photography 61.5
Photo 61.5
Indoors 60.1
Room 59.5
Zebra Crossing 58
Crowd 55.4
Dress 55.2
Person 48.9

Imagga
created on 2022-02-12

people 36.8
businessman 36.2
blackboard 33.7
business 32.8
group 30.6
man 30.5
person 30
male 28.3
gymnasium 28.3
silhouette 28.1
crowd 25.9
men 24.9
team 24.2
athletic facility 22.7
teamwork 19.5
work 18
facility 18
adult 17.3
classroom 17.3
corporate 17.2
businesswoman 16.3
job 15.9
party 15.5
room 15.3
boss 15.3
success 15.3
audience 14.6
women 14.2
symbol 14.1
meeting 14.1
design 13.5
human 13.5
executive 13
office 12.8
professional 12.8
hand 12.1
education 12.1
board 11.9
happy 11.9
communication 11.7
employee 11.5
presentation 11.2
black 10.9
nighttime 10.8
stadium 10.7
worker 10.7
leader 10.6
patriotic 10.5
modern 10.5
vibrant 10.5
nation 10.4
manager 10.2
company 10.2
flag 10.2
lights 10.2
cheering 9.8
teacher 9.6
icon 9.5
art 9.4
youth 9.4
event 9.2
graphic 8.7
standing 8.7
hands 8.7
chart 8.6
businesspeople 8.5
vivid 8.4
spectator 8.2
music 8.1
suit 8.1
light 8
idea 8
night 8
conceptual 7.9
together 7.9
bright 7.9
speech 7.8
class 7.7
gesture 7.6
dance 7.6
finance 7.6
globe 7.4
school 7.4
occupation 7.3
connection 7.3
teenager 7.3
global 7.3
student 7.2
sexy 7.2
celebration 7.2
stage 7.1
interior 7.1
player 7.1

Google
created on 2022-02-12

Font 82.5
Suit 72.9
Event 71.8
Team 66.4
Room 64.2
Team sport 62.6
Stock photography 62
Crew 60.9
Art 59.8
Display device 59.3
Photo caption 56.8
Uniform 56.4
Chair 56
Monochrome 55.8
Advertising 55.8
History 54.7
Symmetry 53.7
Illustration 53.6
Monochrome photography 51.4
Visual arts 51.1

Microsoft
created on 2022-02-12

text 99.2
person 87.7
clothing 70
posing 63.4
man 63
black and white 53.3
old 44.2

Face analysis

Amazon

Google

AWS Rekognition

Age 18-26
Gender Male, 100%
Sad 85.1%
Calm 6%
Confused 5.9%
Angry 1.1%
Disgusted 0.7%
Happy 0.5%
Fear 0.4%
Surprised 0.3%

AWS Rekognition

Age 37-45
Gender Male, 90.9%
Calm 98.3%
Happy 0.8%
Sad 0.4%
Confused 0.1%
Fear 0.1%
Disgusted 0.1%
Surprised 0.1%
Angry 0.1%

AWS Rekognition

Age 38-46
Gender Male, 98.6%
Sad 69.9%
Calm 10.2%
Fear 4.7%
Happy 4.7%
Confused 4.6%
Surprised 2%
Disgusted 2%
Angry 1.9%

AWS Rekognition

Age 41-49
Gender Male, 98.2%
Sad 81.5%
Happy 5.4%
Confused 4%
Calm 3.3%
Angry 1.8%
Disgusted 1.6%
Surprised 1.2%
Fear 1.2%

AWS Rekognition

Age 23-33
Gender Female, 95.5%
Calm 64.5%
Sad 17.4%
Happy 10.2%
Confused 4.9%
Surprised 0.9%
Angry 0.8%
Disgusted 0.8%
Fear 0.4%

AWS Rekognition

Age 35-43
Gender Male, 94.5%
Calm 78.2%
Sad 6.1%
Happy 4.8%
Fear 4.5%
Confused 4.1%
Disgusted 0.9%
Surprised 0.8%
Angry 0.6%

AWS Rekognition

Age 28-38
Gender Male, 93.2%
Calm 99.6%
Happy 0.1%
Sad 0.1%
Disgusted 0%
Angry 0%
Confused 0%
Surprised 0%
Fear 0%

AWS Rekognition

Age 34-42
Gender Male, 78.3%
Sad 52%
Happy 30.8%
Calm 13.1%
Confused 1.4%
Angry 0.9%
Disgusted 0.7%
Surprised 0.5%
Fear 0.4%

AWS Rekognition

Age 49-57
Gender Female, 79.6%
Sad 66%
Happy 13.2%
Confused 12.5%
Calm 5.3%
Fear 0.9%
Surprised 0.7%
Disgusted 0.7%
Angry 0.7%

AWS Rekognition

Age 40-48
Gender Male, 95.4%
Sad 92.7%
Happy 4.3%
Calm 1.5%
Angry 0.6%
Fear 0.3%
Confused 0.3%
Disgusted 0.2%
Surprised 0.2%

AWS Rekognition

Age 33-41
Gender Male, 61.2%
Sad 77.2%
Happy 11.2%
Calm 4.7%
Confused 2.5%
Fear 1.6%
Disgusted 1%
Angry 0.9%
Surprised 0.9%

AWS Rekognition

Age 23-31
Gender Male, 95.6%
Sad 27.1%
Fear 23.7%
Happy 21.4%
Calm 18.8%
Disgusted 2.6%
Surprised 2.3%
Angry 2.2%
Confused 1.8%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99%

Captions

Microsoft

a group of people posing for a photo 80.6%
a group of people posing for the camera 80.5%
a group of people posing for a picture 80.4%

Text analysis

Amazon

ENCYCL
INTERNATIONAL
World
BIG WHEELS
Wonderful World
OPEDIA
Wonderful
4
WORLD'S
ENCYCL OPEDIA X INTERNATIONAL
DEPUL
ENCYCLOPEDIA
WORLD'S MOBREU DEPUL ENCYCLOPEDIA
TOTALLY
X
TOTALLY with
SPENCER
with
WARVERS SPENCER
KODAK-LA--EITW
MOBREU
WARVERS

Google

ENCYCLOPEDIASINTERNATIONAL Wonderful World
Wonderful
ENCYCLOPEDIASINTERNATIONAL
World