Human Generated Data

Title

Untitled (cub scouts gathered around chalkboard)

Date

1954

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10423

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (cub scouts gathered around chalkboard)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1954

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Person 99.5
Human 99.5
Person 99.4
Person 96.2
Person 95.8
Teacher 94.1
Helmet 93.9
Clothing 93.9
Apparel 93.9
Indoors 90.2
Room 90.2
Classroom 88.6
School 88.6
Clinic 77.3
Person 73.3
Text 66.1
People 60.8
Finger 59.9

Imagga
created on 2022-01-09

person 39.2
man 32.2
people 27.3
iron lung 27.1
male 26.2
specialist 24.4
patient 23.7
senior 23.4
breathing device 21.8
respirator 21.7
nurse 19.1
portrait 18.8
old 18.1
home 17.5
adult 17.3
case 17.1
room 17.1
happy 16.9
elderly 16.3
device 16.2
smiling 15.9
medical 15.9
looking 15.2
business 14
human 13.5
retirement 13.4
hospital 13.2
sick person 13.1
couple 13.1
education 13
men 12.9
aged 12.7
retired 12.6
health 12.5
mature 12.1
surgeon 12
student 12
care 11.5
working 11.5
indoors 11.4
office 11.3
doctor 11.3
technology 11.1
work 10.2
happiness 10.2
board 9.9
newspaper 9.8
sixties 9.8
60s 9.8
to 9.7
businessman 9.7
one 9.7
group 9.7
blackboard 9.6
husband 9.5
professional 9.4
smile 9.3
modern 9.1
school 9.1
computer 8.8
medicine 8.8
classroom 8.8
sitting 8.6
uniform 8.6
casual 8.5
finance 8.4
hand 8.4
camera 8.3
holding 8.2
indoor 8.2
family 8
older 7.8
class 7.7
money 7.7
illness 7.6
wife 7.6
horizontal 7.5
writing 7.5
house 7.5
occupation 7.3
lady 7.3
laptop 7.3
pensioner 7.3
black 7.2
teacher 7.2
women 7.1
copy 7.1
job 7.1

Google
created on 2022-01-09

Black-and-white 82.5
Font 77.6
Service 74.8
Monochrome 73.7
Monochrome photography 73.1
Hat 70.6
Event 68.3
Handwriting 67.6
Room 67.5
T-shirt 62.2
Sitting 61.7
History 58.5
Class 55.7
Team 54.8
Photo caption 51.9
Crew 51.9
Job 51.4

Microsoft
created on 2022-01-09

text 99
person 96.5
man 91.6
black and white 71.5
handwriting 65.4
whiteboard 56.9

Face analysis

Amazon

Google

AWS Rekognition

Age 6-14
Gender Female, 98.6%
Calm 98.3%
Surprised 0.8%
Fear 0.2%
Sad 0.2%
Confused 0.2%
Angry 0.1%
Disgusted 0.1%
Happy 0.1%

AWS Rekognition

Age 28-38
Gender Male, 97%
Calm 77.7%
Surprised 15.2%
Confused 2.4%
Happy 1.7%
Angry 1.2%
Sad 1%
Disgusted 0.7%
Fear 0.1%

AWS Rekognition

Age 16-22
Gender Male, 99.3%
Calm 90.3%
Sad 6.2%
Happy 1.3%
Angry 0.8%
Surprised 0.6%
Disgusted 0.4%
Confused 0.3%
Fear 0.2%

AWS Rekognition

Age 18-24
Gender Male, 69.7%
Calm 98.7%
Sad 1.2%
Confused 0%
Surprised 0%
Angry 0%
Disgusted 0%
Happy 0%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Helmet 93.9%

Captions

Microsoft

a group of people posing for a photo 68.2%
an old photo of a man 68.1%
a group of people posing for the camera 68%

Text analysis

Amazon

BANK
DEN
SELLING
LOCAL
BADGERS
METHODS
SARASOTA
PALMER
SELLIN
DENS
CITIZENS
BY
INDIVIDUAL
3. DOOR-TO-DOOR BY DENS
TICKETS
DOOR-TO-DOOR
DRI
2.TICKET
BOYS
METHODS OF SELLING TICKETS
DEN 4- SARASOTA BANK DRI
DEN 2- SARASOTA BANK
3.
1. INDIVIDUAL BOYS SELLIN LOCAL NEIGH
2.TICKET BOOTHS:
3
DEN 3- PALMER BANK
BOOTHS:
DEN 5 CITIZENS BANK +Post O
5
OF
DENI- BADGERS
2-
NEIGH
1.
4-
+Post
DENI-
3-
O
30.69
1

Google

430°69 METHODS OF SELLING TICKETS 1. INDIVIDUAL: BOYS SELLIN LOCAL NEICA 2.TICKET BOOT HS: DENI BADGERS DEN 2- SARASOTA BANK DEN 3- PALMER SANK DEN 4- SARASOTA BANK DR DEN 5 CITIZENS BANK +POST 3 DOOR-TO - DOOR 6Y DENS
1.
INDIVIDUAL:
NEICA
SARASOTA
PALMER
HS:
2-
BANK
5
DOOR
DENS
SELLING
BOYS
SELLIN
BADGERS
DEN
3-
DR
CITIZENS
+POST
3
DOOR-TO
-
METHODS
OF
TICKETS
LOCAL
2.TICKET
DENI
SANK
4-
430°69
BOOT
6Y