Human Generated Data

Title

Untitled (group portrait of Sarasota Bank & Trust Company employees as baseball team)

Date

1969

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.11301

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (group portrait of Sarasota Bank & Trust Company employees as baseball team)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1969

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Person 99.6
Human 99.6
Person 99.4
Person 99.1
Person 98.6
Person 98.1
Person 97.8
Person 96.5
Person 96.1
Person 92.7
Tie 88.8
Accessories 88.8
Accessory 88.8
Tie 87.5
Person 87.1
Sport 86.8
Sports 86.8
Person 86.6
Clothing 84.5
Apparel 84.5
Person 79.4
Skateboard 74
Tie 71.3
Person 70.5
Tie 69.8
Tie 61.8
People 60.8
Martial Arts 59.4
Fencing 58
Floor 57.3
Karate 56.2

Imagga
created on 2022-01-09

person 53.2
nurse 51.8
man 47.1
professional 40.8
male 40.5
doctor 39.5
people 36.3
medical 36.2
hospital 36.1
coat 34.8
business 34.6
businessman 32.7
team 32.3
job 31
happy 30.7
adult 30.6
patient 30
lab coat 28.6
medicine 28.2
portrait 27.8
clinic 27
smiling 26.1
worker 25.8
stethoscope 25.4
colleagues 25.3
health 25
office 24.9
work 24.3
occupation 23.8
group 22.6
corporate 22.4
men 22.3
teamwork 22.3
confident 21.9
golfer 21.5
care 21.4
handsome 21.4
uniform 21.2
standing 20.9
smile 20.7
mature 20.5
working 20.3
clinical 19.5
specialist 18.4
businesswoman 18.2
businesspeople 18
doctors 17.7
successful 17.4
30s 17.3
suit 17.3
profession 17.2
player 17
meeting 17
success 16.1
practitioner 16
40s 15.6
sick person 15.1
case 14.9
surgeon 14.2
associates 13.8
20s 13.7
looking 13.6
casual 13.6
mid adult 13.5
confidence 13.4
contestant 13.4
consultant 12.7
women 12.7
laboratory 12.5
staff 12.3
indoors 12.3
together 12.3
executive 12.2
attractive 11.9
practice 11.6
lifestyle 11.6
partnership 11.5
brass 11.5
bright 11.4
cheerful 11.4
human 11.3
room 11.2
modern 11.2
camera 11.1
treatment 11
clothing 10.9
coworkers 10.8
expertise 10.7
desk 10.4
building 10.4
guy 10.2
happiness 10.2
indoor 10.1
physician 9.8
cooperation 9.7
computer 9.6
illness 9.5
ethnic 9.5
healthy 9.5
cornet 9.4
manager 9.3
face 9.2
friendly 9.2
laptop 9.1
wind instrument 9
crew 8.9
heal 8.8
discussion 8.8
ill 8.8
couple 8.7
partner 8.7
sick 8.7
hands 8.7
table 8.7
diversity 8.7
day 8.6
exam 8.6
career 8.5
smart 8.5
two 8.5
black 8.4
color 8.3
planner 8.3
positive 8.3
one 8.2
clinician 7.9
general practitioner 7.9
business people 7.9
discussing 7.9
medication 7.8
student 7.8
businessmen 7.8
thirties 7.8
partners 7.8
workers 7.8
corporation 7.7
garment 7.7
four 7.7
elderly 7.7
formal 7.6
talking 7.6
tie 7.6
adults 7.6
teacher 7.5
gymnasium 7.5
company 7.4
training 7.4
lady 7.3

Google
created on 2022-01-09

Sleeve 87.1
Font 83.4
Suit 81.9
Monochrome 70.8
Crew 69.3
Event 68.5
Monochrome photography 66
Team 63.2
Uniform 62.9
Room 61.6
Photo caption 60.6
Illustration 56.6
Advertising 52.9
Workwear 51.3
Sports uniform 50.5

Microsoft
created on 2022-01-09

text 91.5
group 65.8
posing 62.3
old 49

Face analysis

Amazon

Google

AWS Rekognition

Age 34-42
Gender Male, 99.7%
Calm 66.8%
Sad 15.9%
Happy 5.4%
Surprised 3.5%
Confused 2.9%
Angry 2.6%
Fear 1.5%
Disgusted 1.3%

AWS Rekognition

Age 48-56
Gender Male, 99.7%
Sad 90.2%
Happy 7.2%
Calm 1.1%
Surprised 0.4%
Confused 0.3%
Fear 0.3%
Disgusted 0.3%
Angry 0.2%

AWS Rekognition

Age 36-44
Gender Male, 90.2%
Calm 99.2%
Confused 0.2%
Angry 0.2%
Sad 0.2%
Surprised 0.1%
Happy 0.1%
Disgusted 0.1%
Fear 0%

AWS Rekognition

Age 29-39
Gender Male, 99.6%
Calm 95.4%
Sad 3.1%
Happy 0.6%
Confused 0.6%
Disgusted 0.1%
Surprised 0.1%
Angry 0.1%
Fear 0.1%

AWS Rekognition

Age 47-53
Gender Male, 95.6%
Happy 86.3%
Calm 4.5%
Fear 2.8%
Surprised 2.5%
Sad 2.1%
Disgusted 0.6%
Confused 0.6%
Angry 0.5%

AWS Rekognition

Age 38-46
Gender Male, 98.8%
Happy 77.3%
Surprised 13.4%
Calm 6.9%
Sad 0.8%
Confused 0.7%
Disgusted 0.3%
Angry 0.3%
Fear 0.2%

AWS Rekognition

Age 43-51
Gender Male, 99.4%
Happy 80.5%
Calm 7.2%
Confused 6.4%
Surprised 2.9%
Angry 1.2%
Disgusted 0.9%
Sad 0.5%
Fear 0.4%

AWS Rekognition

Age 45-53
Gender Male, 92.2%
Calm 71.7%
Happy 26.3%
Surprised 0.5%
Angry 0.4%
Confused 0.3%
Sad 0.3%
Disgusted 0.2%
Fear 0.2%

AWS Rekognition

Age 45-53
Gender Male, 97.5%
Calm 75.6%
Surprised 10.3%
Sad 7.2%
Happy 4.8%
Confused 1%
Angry 0.6%
Disgusted 0.3%
Fear 0.2%

AWS Rekognition

Age 35-43
Gender Male, 99.3%
Happy 54.7%
Confused 18.1%
Calm 15.8%
Surprised 3.9%
Disgusted 3.1%
Sad 2.8%
Angry 1.3%
Fear 0.4%

AWS Rekognition

Age 41-49
Gender Male, 100%
Calm 53.1%
Happy 22.2%
Sad 19.9%
Surprised 1.4%
Disgusted 1.1%
Angry 0.8%
Confused 0.8%
Fear 0.7%

AWS Rekognition

Age 40-48
Gender Male, 99.7%
Calm 51.6%
Happy 39%
Surprised 3.1%
Confused 2.3%
Angry 1.9%
Sad 0.9%
Disgusted 0.7%
Fear 0.5%

AWS Rekognition

Age 43-51
Gender Male, 95.8%
Calm 97.3%
Happy 1.2%
Disgusted 0.6%
Sad 0.3%
Surprised 0.2%
Confused 0.1%
Angry 0.1%
Fear 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Tie 88.8%

Captions

Microsoft

a group of people posing for a photo 88.1%
a group of people posing for the camera 88%
a group of people posing for a picture 87.9%

Text analysis

Amazon

a
59215.
NAGON
عيد

Google

57215.
57215.